BEFORE THE BOARD OF PATENT APPEALS AND INTERFERENCES 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re Application of: 

Cedrick Stanislas Collomb 

Application No. : 1 0/5 80,3 1 0 

Filed: April 17, 2007 

Atty Dkt. SCDY 22.572(100809-00332) 
Examiner: Maurice L. McDowell, Jr. 
For: IMAGE RENDERING 

MAIL STOP APPEAL BRIEF - PATENTS 

Commissioner for Patents 
United States Patent and Trademark Office 
P.O. Box 1450 
Alexandria, VA 223 1 3- 1 450 

APPELLANTS' BRIEF ON APPEAL 
TO THE BOARD OF PATENT APPEALS AND INTERFERENCES 

Pursuant to 37 C.F.R. § 41.37, submitted herewith for the above-identified application 

is Appellants' Appeal Brief, along with the required fee under 37 C.F.R. § 41.20(b). The 

Director is hereby authorized to charge $540.00 for the required fee and any additional fee that 

may be required, or credit any overpayments, to Deposit Account No. 50-1290. If such a 

5 charge is made, please indicate the Attorney Docket No. 100809-00332 (SCDY 22.572) on the 

account statement. 



APPELLANTS' 
BRIEF ON APPEAL 



Brief Filed: December 16, 2009 



Page 1 of 30 



Application No. 10/580,310 
Appellant's Appeal Brief 



I. STATEMENT OF THE REAL PARTY IN INTEREST 

The real party in interest to the above-identified application and to this appeal is the 
assignee, Sony Computer Entertainment Europe, Ltd., by virtue of an assignment recorded on 
5 April 1 7, 2007 in the USPTO, found on reel 01 9264, frame 0859. 
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II. STATEMENT OF RELATED CASES 

Appellants' legal representative and the Assignee of the above-identified patent 
application do not know of any prior or pending appeals, interferences under 37 C.F.R. § 
41.37(g) or judicial proceedings which may be related to, directly affect or be directly affected 
5 by or have a bearing on the Board's decision with respect to the above-identified Appeal. 
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III. JURISDICTIONAL STATEMENT 

The Board has jurisdiction under 35 U.S.C. § 134(a). The Examiner mailed a Final 
Rejection on June 8 5 2009, setting a three-month shortened statutory period for response. A 
Response was filed by the Appellant on September 8, 2009. The Office responded with an 
5 Advisory Action on September 21, 2009. Appellant filed a Notice of Appeal on October 8, 
2009. 
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IV. STATUS OF CLAIMS 

Claims 1-9 and 13-15 are pending in the present application. A copy of the appealed 
claims is included in the Claims Appendix. 
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V. STATUS OF AMENDMENTS 

None of the present claims have been amended or canceled since the issuance of the 
Office's Final Office Action of June 8, 2009, 2009. Copies of the Final Office Action and the 
Advisory Action are attached as Exhibits A and B respectively in the Evidence Appendix. 

5 
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VI. SUMMARY OF CLAIMED SUBJECT MATTER 

A summary of the invention by way of reference to the drawings and specification for 
each of the independent claims is provided as follows: 

Independent claim 1 recites a method performed by a computer of forming a two 
dimensional map of a three dimensional environment ([0060, 0066]). A map origin (FIG. 7, 
1340; FIG. 10, 1600) is located in the three dimensional environment, where a viewing 
direction vector (FIG. 6, 1250; [0069]) is defined passing through the map origin (FIG. 7, 
1340; [0070]), and a one-to-one correspondence is established between map positions in the 
map and the directions of vectors passing through the map origin ([0078]). The method 
includes the steps of associating an environment position in the three dimensional environment 
(FIG. 10; [0079]) with a folded vector (FIG. 11, 1700) that passes through the map origin (FIG. 
11, 1600), where the folded vector lies in a plane (FIG. 13, 1800) that contains both the 
viewing direction vector and the environment position ([0080-83]). The method also includes 
the step of forming an angle with the viewing direction vector that is a predetermined function 
of the angle between the viewing direction vector and a vector between the map origin and the 
environment position ([0080-83]). An environment position is associated with the map 
position corresponding to the direction of the folded vector associated with that environment 
position (FIG. 11; [0080-83]), and the computer properties are derived for a map position from 
the properties of the corresponding environment position ([0079-85]). 

Dependent claim 2 recites the features of claim 1 and further recites that the 
predetermined function is a multiplication by a predetermined quantity ([0080]). 
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Dependent claim 3 recites the features of claim 2 and further recites that the 
predetermined function is a multiplication by 0.5 ([0080]). 

5 Dependent claim 4 recites the features of claim 1 and further recites that the one-to-one 

correspondence of a map point with the direction of a vector through the map origin represents 
a projection onto a predetermined plane of a point on the vector which is a predetermined 
distance from the map origin (FIG. 12; [0081-85]). 

10 Dependent claim 5 recites the features of claim 4 and further recites that the 

predetermined plane is a plane orthogonal to the viewing direction vector ([0073]). 

Dependent claim 6 recites an image rendering method that includes the steps of 
generating a two dimensional map of a three dimensional environment using the method 

15 according to claim 1, where, for a point of interest on an object to be displayed, a reflection 
vector is derived in dependence on a normal vector at the point of interest and a direction of 
view ([0066-69]). Additionally, a position is referenced in the two dimensional map using the 
reflection vector, to detect environmental properties at that map position ([0069]). Also, the 
appearance of the object is varied at the point of interest in dependence on the detected 

20 environmental properties ([007 1 -72]). 

Dependent claim 7 recites the features of claim 6, in which the varying step is 
performed in dependence on a reflectivity of the object at the point of interest ([0069-70]). 
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Dependent claim 8 recites the features of claim 6, in which the environmental properties 
represent lighting properties ([0070]). 

5 Dependent claim 9 recites a computer-readable medium having instructions stored 

therein which when executed, cause a computer to perform the method according to claim 1 
(FIG. 1). 

Independent claim 13 recites an apparatus for forming a two dimensional map of a three 
10 dimensional environment ([0060, 0066]), there being a map origin (FIG. 7, 1340; FIG. 10, 
2600) located in the three dimensional environment, a viewing direction vector (FIG. 6, 1250; 
[0069]) defined passing through the map origin (FIG. 7, 1340; [0070]), and a one-to-one 
correspondence between map positions in the map and the directions of vectors passing through 
the map origin ([0078]). The apparatus comprises means for associating an environment 
15 position in the three dimensional environment (FIG. 10; [0079]) with a folded vector (FIG. 1 1, 
1700) that passes through the map origin (FIG. 1 1, 1600). The folded vector is lying in a plane 
containing both the viewing direction vector and the environment position ([0080-83]) and 
forms an angle with the viewing direction vector that is a predetermined function of the angle 
between the viewing direction vector and a vector between the map origin and the environment 
20 position ([0080-83]). The apparatus also includes means for associating an environment 
position with the map position corresponding to the direction of the folded vector associated 
with that environment position ([0080-83]). Also included is means for deriving properties for 
a map position from the properties of the corresponding environment position ([0079-85]). 
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Dependent claim 14 recites the map generating apparatus according to claim 13 and 
also includes means for deriving a reflection vector, in respect of a point of interest on an object 
to be displayed, in dependence on a normal vector at the point of interest and a direction of 
5 view ([0066-69]); means for referencing a position in the two dimensional map using the 
reflection vector, to detect environmental properties at that map position ([0069]); and means 
for varying the appearance of the object at the point of interest in dependence on the detected 
environmental properties ([0071-72]). 

10 Dependent claim 15 recites a video game machine comprising apparatus according to 

claim 13 (FIG. 1). 

Although specification citations are given in accordance with C.F.R. 1.192(c), these 
reference numerals and citations are merely examples of where support may be found in the 

1 5 specification for the terms used in this section of the Brief. There is no intention to suggest in 
any way that the terms of the claims are limited to the examples in the specification. As 
demonstrated by the citations above, the claims are fully supported by the specification as 
required by law. However, it is improper under the law to read limitations from the 
specification into the claims. Pointing out specification support for the claim terminology as is 

20 done here to comply with rule 1.192(c) does not in any way limit the scope of the claims to 
those examples from which they find support. Nor does this exercise provide a mechanism for 
circumventing the law precluding reading limitations into the claims from the specification. In 
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short, the specification citations are not to be construed as claim limitations or in any way used 
to limit the scope of the claims. 
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VII. GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 



1. Claims 1-9 and 13-15 were rejected under 35 U.S.C. §103(a) as being unpatentable 
over Voorhies (US Patent No. 5,704,024), in view of Cerny. (US Patent Pub. 
5 2003/0112238). A copy of the Voorhies and Cerny documents are attached hereto 

as Exhibits C and D, respectively. 
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VIII. ARGUMENT 

A. LEGAL STANDARDS 

Obviousness under 35 U.S. C. §103 

Regarding Obviousness, 

5 Section 103 forbids issuance of a patent when "the differences 

between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in 
the art to which said subject matter pertains." 

10 

KSR Int'l Co. v. Teleflex Inc., 550 U.S. 398, 406 (2007). The question of obviousness is 
resolved on the basis of underlying factual determinations including (1) the scope and content 
of the prior art, (2) any differences between the claimed subject matter and the prior art, (3) the 
level of skill in the art, and (4) where in evidence, so-called secondary considerations. Graham 

15 v. John Deere Co., 383 U.S. 1, 17-18 (1966). See also KSR, 550 U.S. at 407 ("While the 
sequence of these questions might be reordered in any particular case, the [Graham] factors 
continue to define the inquiry that controls.") 

The Supreme Court stated that in cases involving more than the simple substitution of 
one known element for another or the mere application of a known technique to a piece of prior 

20 art ready for the improvement, it will be necessary to "determine whether there was an apparent 
reason to combine the known elements in the fashion claimed by the patent at issue." Id. at 417- 
418. The Court noted that "[t]o facilitate review, this analysis should be made explicit." Id. at 
418 (citing In re Kahn, 441 F.3d 977, 988 (Fed. Cir. 2006) ("[R] ejections on obviousness 
grounds cannot be sustained by mere conclusory statements; instead, there must be some 

25 articulated reasoning with some rational underpinning to support the legal conclusion of 
obviousness")). 
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Rejections based on 35 U.S.C. § 103 must rest on a factual basis. In making such a 
rejection, the examiner has the initial duty of supplying the requisite factual basis and may not, 
because of doubts that the invention is patentable, resort to speculation, unfounded assumptions 
or hindsight reconstruction to supply deficiencies in the factual basis. In re Warner, 379 F.2d 
1011, 1017 (CCPA 1967). 

B. THE CLAIMED INVENTION 

The claimed features address image rendering in a virtual environment surrounding a 
displayed object to contribute to the surface appearance of the object. As discussed above in 
section VI, independent claim 1 recites a method performed by a computer of forming a two 
dimensional map of a three dimensional environment ([0060, 0066]). A map origin (FIG. 7, 
1340; FIG. 10, 1600) is located in the three dimensional environment, where a viewing 
direction vector (FIG. 6, 1250; [0069]) is defined passing through the map origin (FIG. 7, 
1340; [0070]), and a one-to-one correspondence is established between map positions in the 
map and the directions of vectors passing through the map origin ([0078]). The method 
includes the steps of associating an environment position in the three dimensional environment 
(FIG. 10; [0079]) with a folded vector (FIG. 11, 1700) that passes through the map origin (FIG. 
11, 1600), where the folded vector lies in a plane (FIG. 13, 1800) that contains both the 
viewing direction vector and the environment position ([0080-83]). The method also includes 
the step of forming an angle with the viewing direction vector that is a predetermined function 
of the angle between the viewing direction vector and a vector between the map origin and the 
environment position ([0080-83]). An environment position is associated with the map 
position corresponding to the direction of the folded vector associated with that environment 
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position (FIG. 11; [0080-83]), and the computer properties are derived for a map position from 
the properties of the corresponding environment position ([0079-85]). 

Dependent claim 2 recites the features of claim 1 and further recites that the 
5 predetermined function is a multiplication by a predetermined quantity ([0080]). Dependent 
claim 3 recites the features of claim 2 and further recites that the predetermined function is a 
multiplication by 0.5 ([0080]). Dependent claim 4 recites the features of claim 1 and further 
recites that the one-to-one correspondence of a map point with the direction of a vector through 
the map origin represents a projection onto a predetermined plane of a point on the vector 
10 which is a predetermined distance from the map origin (FIG. 12; [0081-85]). Dependent claim 
5 recites the features of claim 4 and further recites that the predetermined plane is a plane 
orthogonal to the viewing direction vector ([0073]). 

Dependent claim 6 recites an image rendering method that includes the steps of 
15 generating a two dimensional map of a three dimensional environment using the method 
according to claim 1, where, for a point of interest on an object to be displayed, a reflection 
vector is derived in dependence on a normal vector at the point of interest and a direction of 
view ([0066-69]). Additionally, a position is referenced in the two dimensional map using the 
reflection vector, to detect environmental properties at that map position ([0069]). Also, the 
20 appearance of the object is varied at the point of interest in dependence on the detected 
environmental properties ([0071-72]). Dependent claim 7 recites the features of claim 6, in 
which the varying step is performed in dependence on a reflectivity of the object at the point of 
interest ([0069-70]). Dependent claim 8 recites the features of claim 6, in which the 
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environmental properties represent lighting properties ([0070]). Dependent claim 9 recites a 
computer-readable medium having instructions stored therein which when executed, cause a 
computer to perform the method according to claim 1 (FIG. 1). 

Independent claim 13 recites an apparatus for forming a two dimensional map of a three 
dimensional environment ([0060, 0066]), there being a map origin (FIG. 7, 1340; FIG. 10, 
2600) located in the three dimensional environment, a viewing direction vector (FIG. 6, 1250; 
[0069]) defined passing through the map origin (FIG. 7, 1340; [0070]), and a one-to-one 
correspondence between map positions in the map and the directions of vectors passing through 
the map origin ([0078]). The apparatus comprises means for associating an environment 
position in the three dimensional environment (FIG. 10; [0079]) with a folded vector (FIG. 11, 
1700) that passes through the map origin (FIG. 11, 1600). The folded vector is lying in a plane 
containing both the viewing direction vector and the environment position ([0080-83]) and 
forms an angle with the viewing direction vector that is a predetermined function of the angle 
between the viewing direction vector and a vector between the map origin and the environment 
position ([0080-83]). The apparatus also includes means for associating an environment 
position with the map position corresponding to the direction of the folded vector associated 
with that environment position ([0080-83]). Also included is means for deriving properties for 
a map position from the properties of the corresponding environment position ([0079-85]). 

Dependent claim 14 recites the map generating apparatus according to claim 13 and 
also includes means for deriving a reflection vector, in respect of a point of interest on an object 
to be displayed, in dependence on a normal vector at the point of interest and a direction of 
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view ([0066-69]); means for referencing a position in the two dimensional map using the 
reflection vector, to detect environmental properties at that map position ([0069]); and means 
for varying the appearance of the object at the point of interest in dependence on the detected 
environmental properties ([0071-72]). Dependent claim 15 recites a video game machine 
comprising apparatus according to claim 13 (FIG. 1). 

C. CLAIMS 1-9 AND 13-15 WERE IMPROPERLY REJECTED UNDER 35 U.S.C. 
§ 103(A) AS BEING UNPATENTABLE OVER VOORHIES (US PATENT NO. 
5,704,024), IN VIEW OF CERNY. (US PATENT PUB. 2003/01 12238), AS THE 
EXAMINER HAS FAILED TO MAKE A PRIMA FACIE CASE OF OBVIOUSNESS. 

As argued previously by Appellant, Voorhies discloses a technique for generating 
reflection vectors to index an existing environment map, such as a known cubic map (col. 6, 
line 22 - col. 7, line 25). In contrast, the independent claims of the present application relate to 
a different, earlier, stage in the process - in particular, to the generation of a new type of 
environment map itself. 

Claim 1 (and similarly claim 13) recites "forming a two dimensional map of a three 
dimensional environment" (i.e. generating an environment map). By contrast, col. 9, lines 24 
to 27 Voorhies, cited for this feature, states that "the present invention provides a method ... for 
generating reflection vectors which can be unnormalized (i.e. have non-unit lengths) and for 
using these reflection vectors to index locations on an environment map" (see also col. 8, lines 
14-49). Thus, a plain reading of this passage teaches that Voorhies is generating a new type of 
reflection vector, and not a new type of environment map. 

This is apparent from FIGs. 3 and 6, as well as col. 10, lines 45-64 of Voorhies. 
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FIG. 6 

As can be seen in FIG. 6, Voorhies uses a conventional cube mapping arrangement, 
where six two-dimensional environment maps are positioned around the object (P) so as to 
cover all possible angles of reflection. This is the 'three dimensional environment map' of 
Voorhies, which is materially different from the claimed configuration. 

Appellant submits that an "actual" three dimensional environment and an "environment 
map of that three dimensional environment" are two different technical concepts. It should be 
easily appreciated that such a "three dimensional environment map" is not the actual three- 
dimensional environment itself, but a specific representation of it used for the computationally 
efficient generation of reflections in an object that looks as if they have come from the actual 
three-dimensional environment. The presently claimed invention makes this distinction 
between a map and an environment in Claim 1, which recites "forming a two dimensional map 
of a three dimensional environment." 

Turning to FIG. 3 of Voorhies, for a given point on the object being rendered, a 
reflection vector is computed and the appropriate one of the six environment texture maps that 
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this vector hits is identified (col. 10, line 50). The exact position on this map where the vector 
hits identifies (indexes) the texture pixel recalled for use in rendering the apparent reflection of 
the environment at that point on the object (col. 10 lines 57 to 64). This rendering process in 
Voorhies is entirely conventional, in that it computes reflection vectors and retrieves texture 
information from where that reflection vector points to on an environment map. This feature is 
concerned with simplifying computation of the reflection vectors themselves (i.e. not 
normalizing them). 

Claim 1 (and similarly claim 13) recites "deriving by the computer properties for a map 
position from the properties of the corresponding environment position." Thus feature line 
therefore requires: 

i. an environment position; 

ii. a map position corresponding to it; and 

iii. deriving a property for that map position from the corresponding environment 
position (e.g. deriving a texture pixel color). 

The Examiner cites col. 12, lines 24-31 of Voorhies, and states that reflection vectors 
(from the object being rendered) are used to identify a location on an environment map and 
retrieve the appropriate shading value from the map. Thus, the Examiner's own reading of 
Voorhies demonstrates a conventional retrieval of texture data from a map at the appropriate 
reflection point. However, it clearly does not demonstrate deriving initial data for the map 
(which Voorhies then retrieves), and moreover does not mention deriving such data from a 
corresponding position in the original environment. 

Thus the above passages of Voorhies cited by the Examiner refer merely to the 
conventional use of environment maps, and not in any way their generation. At col. 11, lines 
50 to 63, Voorhies mentions the entirely conventional generation of two dimensional 
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environment maps. However, this is the only teaching in Voorhies directed to generating such 
maps. 

Since Voohies does not deal with the generation of two-dimensional environment maps, 
it follows that Voorhies does not teach or suggest the following related features found in Claim 
1 (and similarly in claim 13): 

i. a plane containing both a viewing direction vector and an environment position 
(i.e. the position currently under analysis) - see plane 1800 of FIG. 13 and the 
accompanying text of the present application for details; 

ii. associating with that environment position a folded vector lying within the 
above plane - see FIG. 1 1 and the accompanying text of the present application 
for details; 

iii. the folded vector having an angle that is a function of the angle between the 
viewing direction vector and a vector between the map origin and the 
environment position - for details, see the equation at page 15 line 25 of the 
description (paragraph [0087] in the published application), which halves the 
angle between the viewing direction vector and a vector between the map origin 
and the environment position within the above plane; 

iv. associating the environment position with the map position corresponding to the 
folded vector - see FIG. 15 and page 16 lines 10 to 24 (paragraphs [0090-93]), 
where projection plane 1850 represents the surface of the map being generated; 
and 
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v. deriving a property for that map position (based on the folded vector) from the 
corresponding environment position - see again FIG. 15 and page 16 lines 10 to 
24 for details. 

Again, an environment map is not the environment itself but a particular and separate 
representation of that environment; Voorhies even makes this distinction at col. 11 lines 50-51 
and col. 11 lines 55-58. Claims 1 and 13 also makes the same distinction between 
environmental maps and the environment itself, reciting "forming a two dimensional map of a 
three dimensional environment." It is respectfully submitted that it does not make technical 
sense to equate the three dimensional environment of Claim 1 with maps of a three dimensional 
environment from Voorhies, and in addition it is inconsistent with the teaching of Voorhies as 
outlined above. Hence it also does not make technical sense to apply passages relating to the 
recall of data from such maps with a claim to the generation of such maps. 

In the Final Office Action (paragraph 5), the Examiner argues that Voorhies is 
concerned with generating map properties of a 3D environment, based on col. 11 lines 29-33. 
However as Appellant has already noted above, it should be clearly understood that a "3D 
environment map" is for example a cubic arrangement of six environment maps that 
themselves represent the actual 3D environment, but therefore clearly are not the 3D 
environment itself. The cited passage clearly relates to locating values in a 3D environment 
map. It therefore clearly does not teach or suggest generating properties for a map from a 3D 
environment. 

Also in paragraph 7 of the Final Office Action, the Examiner argues that multiplier 
1525 is a predetermined function relating the folded vector to other quantities. However, 
Voorhies does not have a folded vector as claimed. Nowhere in Voorhies is a folded vector 
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disclosed with the claimed property of having an angle that is a function of an angle between 
the viewing direction vector and a vector between a map origin and an environment position; 
firstly, there are no vectors between the map origin and the environment position because in the 
cited passage Voorhies is using existing environment maps, not the environment itself, as made 
clear above; secondly there is no plane disclosed containing both a viewing direction vector and 
an environment position; and thirdly, there is no disclosure of a folding vector lying within that 
plane. As a result there is no disclosure of the relationship of such a folding vector in such a 
plane with such other vectors and environment positions. By contrast, it is clear from FIG. 12 
of Voorhies that multiplier 1525 is applied to reflection vectors between the object and an 
existing environment map for the purpose of selecting a position on that map. 

Throughout the Office Action, Appellants respectfully submit that there appears to be a 
consistent equivalence given between generating properties of an environment map (as in the 
present invention) and locating properties of an existing environment map (as in Voorhies). 
Such a position is improper. 

As a further example, the Office Action appears to be equating the "raw" reflection 
vector (R x , R y , R z ) in Voorhies (col. 11, lines 41-32) to the "modified" reflection vector that is 
derived from it (col. 12, lines 24-28 and col. 13, lines 61-65). The Office Action also appears 
to be equating the "viewing direction vector" of Claim 1 to the Eye vector E in Voories; and the 
"folded vector" of Claim 1 to the modified reflection vector. This interpretation is simply 
incorrect. 

The modified reflector vector of Voorhies is derived as a vector product of E and the 
normal vector N, followed by some internal manipulation (dividing one or more vector 
components of the raw reflection vector by numbers derived from other vector components). 
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In contrast, Claim 1 defines the folded vector as follows: 

A. it "passes through the map origin." 

B. it is associated with "an environment position in the three dimensional 
environment" for which Appellant sees no equivalent in Voorhies - because 
Voorhies is not concerned with generating map properties in respect of a 3-D 
environment. 

C. it lies in "a plane containing both the viewing direction and the environment 
position" - because there is no analogy in Voorhies to the environment position, 
this feature is not found in Voorhies. 

D. it forms "an angle with the viewing direction vector that is a predetermined 
function of the angle between the viewing direction vector and a vector between 
the map origin and the environment position" - because there is no environment 
position defined, this feature is not found in Voorhies. 

E. it forms an association between a map position and the environment position - 
again, because there is no environment position defined, this feature is not found 
in Voohries. 

Therefore, it is respectfully submitted that most of the recitation of Claim 1, relating to 
the definition of the folded vector, is not found in Voorhies. 

Going further, the Office Action appear to equate the "predetermined function" (a 
multiplication function in Claim 2) to the multiplier 1325. However, the full recitation of 
Claim 1 is that the "folded vector forms an angle with the viewing direction vector that is a 
predetermined function of the angle between the viewing direction vector and a vector between 
the map origin and the environment position." It is respectfully submitted that the multiplier 
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1325 merely provides a x2 function in the calculation of the expression R = 2*N*(N-E)- 
E*(N-N) (Voorhies col. 11, line 47), as such it is just a scaling factor in an arbitrarily selected 
equation - it is not a predetermined function relating the folded vector to the other quantities, as 
recited in Claim 1 . 

With respect to Claim 3, contrary to what is alleged in the Office Action that 1320 of 
FIG. 1 1 in Voorhies is a multiplication by 0.5; it is submitted that 1320 multiples E by (N*N). 

In summary, Voorhies is concerned with a method of using unnormalized reflection 
vectors during use of a cubic reflection mapping, and discloses purely conventional methods of 
generating the environment maps used for such cubic reflection mapping. Voorhies fails to 
teach or suggest, with respect to generating environment maps, at least the aforementioned five 
features of Claim 1. 

Regarding Cerny, the document teaches an arrangement for applying (rather than 
generating) an environment map. FIG. 3 of Cerny shows a map origin (point P 305) and a 
relationship between a viewing direction (vector e, referred to as an observation vector) and a 
reflection vector (vector r). That is all. It is respectfully submitted that there is no teaching of 
the sort that is alleged in section 8 of the Office Action. 

The Examiner argues that paragraph [0030] of Cerny discloses generating an 
environment map. Appellant disagrees. Cerny is in fact concerned with a different type of 
environment mapping than Voorhies (and the present invention), being concerned with the 
illumination of objects by virtual light sources, rather than with the reflection of an 
environment by an object (see paragraph [0005]) of Cerny). As a result Cerny does not require 
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an environment map representing the (non-existent) environment as the environment is not 
reflected. 

Rather, as is clear from paragraph [0007] of Cerny, 2l texture map for application to the 
object itself is being generated based upon how virtual lights illuminate the object. It should be 
5 readily appreciated that a texture map of an object is fundamentally different to a two 
dimensional environment texture map for an environment surrounding the object and which is 
used to compute how that environment is reflected by the object. Reading paragraph [0030] 
of Cerny in light of paragraph [0007], it is clear that paragraph [0030] relates to generating the 
texture on the object and is not relevant to the presently claimed invention. Appellant also 
10 respectfully asserts that neither paragraph [0030] or any other part of Cerny teaches or suggests 
the aforementioned features of Claim 1 or 13. For the same reasons, there is no apparent 
reason why one skilled in the art would combine the references in the manner suggested by the 
Examiner. 

For at least these reasons, Appellant submits the rejections to claims 1-9 and 13-15 are 
1 5 improper and should be reversed. 
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IX. CONCLUSION 

In view of the above, Appellant submits that the combination of Voorhies and Cerny 
fail to teach every element of Claims 1-9 and 13-15 under U.S.C. § 103(a). Additionally, there 
is no reason why one skilled in the art would combined the documents in the manner suggested 
5 by the examiner. Accordingly, reversal of the final rejections, allowance of the rejected claims, 
and issuance of the subject patent application are respectfully requested. 

Appellants' undersigned attorney may be reached by telephone at (212) 940-631 1. All 
correspondence should continue to be directed to our address provided herewith. 

Respectfully submitted, 

10 £ 

/Pedro C. Fernandez/ 0 
Pedro C. Fernandez 
Attorney for Appellants 
Registration No. 41,741 

15 
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CLAIMS APPENDIX 

PENDING CLAIMS ON APPEAL OF 
U.S. PATENT APPLICATION SERIAL NO. 10/580,310 

5 1 . A method performed by a computer of forming a two dimensional map of a 

three dimensional environment, there being a map origin located in the three dimensional 
environment, a viewing direction vector defined passing through the map origin, and a one-to- 
one correspondence between map positions in the map and the directions of vectors passing 
through the map origin; 

10 the method comprising the steps of: 

associating by the computer an environment position in the three dimensional 
environment with a folded vector that passes through the map origin, the folded vector lying 
in a plane containing both the viewing direction vector and the environment position and 
forming an angle with the viewing direction vector that is a predetermined function of the 

15 angle between the viewing direction vector and a vector between the map origin and the 
environment position; 

associating by the computer an environment position with the map position 
corresponding to the direction of the folded vector associated with that environment position; 
and 

20 deriving by the computer properties for a map position from the properties of the 

corresponding environment position. 

2. A method according to claim 1, in which the predetermined function is a 
multiplication by a predetermined quantity. 

25 
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3. A method according to claim 2, in which the predetermined function is a 
multiplication by 0.5. 

4. A method according to claim 1, in which the one-to-one correspondence of a map 
5 point with the direction of a vector through the map origin represents a projection onto a 

predetermined plane of a point on the vector which is a predetermined distance from the map 
origin. 

5. A method according to claim 4, in which the predetermined plane is a plane 
1 0 orthogonal to the viewing direction vector. 

6. An image rendering method comprising the steps of: 

generating a two dimensional map of a three dimensional environment using a method 
according to claim 1 ; 

15 for a point of interest on an object to be displayed, deriving a reflection vector in 

dependence on a normal vector at the point of interest and a direction of view; 

referencing a position in the two dimensional map using the reflection vector, to detect 
environmental properties at that map position; and 

varying the appearance of the object at the point of interest in dependence on the 
20 detected environmental properties. 

7. A method according to claim 6, in which the varying step is performed in 
dependence on a reflectivity of the object at the point of interest. 
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8. A method according to claim 6, in which the environmental properties represent 
lighting properties. 



9. A computer-readable medium having instructions stored therein which when 
5 executed, cause a computer to perform the method according to claim 1 . 

10. -12. (Cancelled) 

13. Apparatus for forming a two dimensional map of a three dimensional 
10 environment, there being a map origin located in the three dimensional environment, a 
viewing direction vector defined passing through the map origin, and a one-to-one 
correspondence between map positions in the map and the directions of vectors passing 
through the map origin; the apparatus comprising: 

means for associating an environment position in the three dimensional environment 
1 5 with a folded vector that passes through the map origin, the folded vector lying in a plane 
containing both the viewing direction vector and the environment position and forming an 
angle with the viewing direction vector that is a predetermined function of the angle between 
the viewing direction vector and a vector between the map origin and the environment 
position; 

20 means for associating an environment position with the map position corresponding to 

the direction of the folded vector associated with that environment position; and 

means for deriving properties for a map position from the properties of the 
corresponding environment position. 
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14. An image rendering apparatus comprising: 
map generating apparatus according to claim 13; 

means for deriving a reflection vector, in respect of a point of interest on an object to 
be displayed, in dependence on a normal vector at the point of interest and a direction of 
5 view; 

means for referencing a position in the two dimensional map using the reflection 
vector, to detect environmental properties at that map position; and 

means for varying the appearance of the object at the point of interest in dependence 
on the detected environmental properties. 

10 

15. A video game machine comprising apparatus according to claim 13. 
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EXHIBIT A: 



Final Office Action dated June 8, 2009. 



EXHIBIT B: 



Advisory Action dated September 21, 2009. 



EXHIBIT C: 



Voorheis (US Patent No. 5,704,024), cited by the Examiner in the Final 



Office Action dated June 8, 2009. 



EXHIBIT D: 



Cerny (US Patent Pub. 2003/0112238), cited by the Examiner in the Final 



Office Action dated June 8, 2009. 
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DETAILED ACTION 



Response to Arguments 



1. 



Applicant's arguments filed 3/23/2009 have been fully considered but they are not 



persuasive. 



2. 



Applicant argues: Initially, at a basic level, Voorhies discloses a technique for generating 



reflection vectors to index an existing environment map, such as a known cubic map. The 
independent claims of the present application relate to a different, earlier, stage in the process - ii 
particular, to the generation of a new type of environment map itself. Therefore, Voorhies, at 
least, does not disclose the first line of Claim 1, nor does it disclose the last two lines of Claim 1. 
3. Examiner argues : Voorhies, does disclose the first line of Claim 1, see col. 9 lines 24-27 
(The present invention provides a method and an apparatus for generating reflection vectors 
without vector normalization and for using these reflection vectors to index a three dimensional 
environment map) and discloses the last two lines of Claim 1 see col. 12 lines 24-3 1 (At step 
620, the R, and Rz 25 components are divided by the magnitude of the R, component to 
determine the indexed location on the x equals one face of the environment map (which in this 
example is at y=0.4 and z=-0.8). The values for the indexed location on the indexed face are then 
used in the conventional manner to 30 retrieve the appropriate shading values from the indexed 
face of the map. The indexed location on the selected 2-D map can then be supplied to 
conventional texture mapping algorithms or devices, which then determine the surface shading 
attributes 35 for the pixel representing displayed point P on the display device. For example, the 
texture mapping device could determine the pixel shading attributes by averaging the intensity 
values within the indexed region of the indexed face of the 2-D map). 
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4. Applicant argues: The Office Action appears to be equating the "raw" reflection vector 
(Rx, Ry, Rz) in Voorhies (col. 1 1, lines 41-32) to the "modified" reflection vector that is derived 
from it (col. 12, lines 24-28 and col. 13, lines 61-65). The Office Action also appears to be 
equating the "viewing direction vector" of Claim 1 to the Eye vector E in Voorhies; and the 
"folded vector" of Claim 1 to the modified reflection vector. Applicant disagrees with these 
alleged correspondences for the following reasons: The modified reflector vector of Voorhies is 
derived as a vector product of E and the normal vector N, followed by some internal 
manipulation (dividing one or more vector components of the raw reflection vector by numbers 
derived from other vector components). In contrast, Claim 1 defines the folded vector as follows: 
A. it "passes through the map origin" - this may have an analogy with the cubic and octahedral 
maps of Voorhies. B. it is associated with "an environment position in the three dimensional 
environment" for which Applicant sees no equivalent in Voorhies - because Voorhies is not 
concerned with generating map properties in respect of a 3-D environment. C. it lies in "a plane 
containing both the viewing direction and the environment position" - because there is no 
analogy in Voorhies to the environment position, this feature is not found in Voorhies. D. it 
forms "an angle with the viewing direction vector that is a predetermined function of the angle 
between the viewing direction vector and a vector between the map origin and the environment 
position" - because there is no environment position defined, this feature is not found in 
Voorhies. E. it forms an association between a map position and the environment position -again, 
because there is no environment position defined, this feature is not found in Voorhies. 
Therefore, it is respectfully submitted that most of the recitation of Claim 1, relating to the 
definition of the folded vector, is not found in Voorhies. 
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5. Examiner argues: Voorhies is concerned with generating map properties in respect of a 3- 
D environment see col. 1 1 lines 29-33 (... using these reflection vectors to index locations on a 
cubic environment map (3D) which is aligned with the coordinate system (2D) which specifies 
the reflection vector) this argument can apply as well to arguments A-E. 

6. Applicant argues: It is respectfully submitted that the multiplier 1325 merely provides a 
x2 function in the calculation of the expression R - 2*N*(N.E)-E*(N.N) (Voorhies col. 1 1, line 
47), as such it is just a scaling factor in an arbitrarily selected equation - it is not a predetermined 
function relating the folded vector to the other quantities, as recited in Claim 1 . 

7. Examiner argues: It is a predetermined function relating the folded vector to the other 
quantities see fig. 12, 1525 and col. 16 lines 9-20 (These multipliers in turn generate the indexed 
location on the indexed face of the cubic environment map by multiplying the two minor 
coordinates by the output of the divider). 

8. Applicant argues: With respect to Claim 3, contrary to what is alleged in the Office 
Action that 1320 of Figure 1 1 in Voorhies is a multiplication by 0.5; it is submitted that 1320 
multiples E by (N'N). 

9. Examiner argues: See fig. 12, 1525 col. 16 lines 16-19 (The multipliers could multiply by 
1/2 or the divider could divide by 2 yielding the same result). 

10. Applicant argues: Looking at Cerny, again this is an arrangement for applying (rather 
than generating) an environment map. Figure 3 of Cerny shows a map origin (point P 305) and a 
relationship between a viewing direction (vector e, referred to as an observation vector) and a 
reflection vector (vector r). That is all. 
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1 1 . Examiner argues: Cerny does teach generating an environment map, see [0030] (The 
method then processes the reflection vector r to generate texture coordinates (s, t) for each point 
P). 

Claim Rejections - 35 USC § 103 

12. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

13. Claims 1-9, 13-15 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Voorhies et al. Patent No.: 5,704,024 in view of Cerny et al. Pub. No.: US 2003/01 12238 Al. 

14. Regarding claim 1 , Voorhies teaches: A method performed by a computer of forming a 
two dimensional map of a three dimensional environment, there being a map origin located in the 
three dimensional environment, a viewing direction vector defined passing through the map 
origin, and a one-to-one correspondence between map positions in the map and the directions of 
vectors passing through the map origin; the method comprising the steps of: associating by the 
computer an environment position in the three dimensional environment with a folded vector that 
passes through the map origin, the folded vector lying in a plane containing both the viewing 
direction vector and the environment position and forming an angle with the viewing direction 
vector that is a predetermined function of the angle between the viewing direction vector and a 
vector between the map origin and the environment position (fig. 9) (R is the folded vector 



i 
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because Rx and Ry components are divided by the magnitude of the sum of the reflection vector 
components (i.e., divided by 5.5) to determine the indexed location on face four of the 
environment map, also R passes through the origin and forms an angle with the viewing direction 
vector E); and deriving by the computer properties for a map position from the properties of the 
corresponding environment position (fig. 6 see also col. 12 lines 13-31). 

15. Voorhies doesn't teach: associating by the computer an environment position with the 
map position corresponding to the direction of the folded vector associated with that 
environment position. 

1 6. The analogous prior art Cerny teaches: associating by the computer an environment 
position with the map position corresponding to the direction of the folded vector associated with 
that environment position (fig. 3 see also [0030]) for the benefit of to implement a system and 
method of environment mapping that depends upon an observer's location with respect to an 
object's location and orientation to generate a more realistic reflection pattern, and that is 
consistent with results of the direct normal projection method for particular object-observer 
geometries. 

1 7. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine associating by the computer an environment position with the map 
position corresponding to the direction of the folded vector associated with that environment 
position as shown in Cerny with Voorhies for the benefit of to implement a system and method 
of environment mapping that depends upon an observer's location with respect to an object's 
location and orientation to generate a more realistic reflection pattern, and that is consistent with 
results of the direct normal projection method for particular object-observer geometries. 



Application/Control Number: 1 0/5 80,3 1 0 p age 7 

Art Unit: 2628 

1 8. Regarding claim 2, Voorhies teaches: A method, in which the predetermined function is a 
multiplication by a predetermined quantity (fig. 12, 1525 see also col. 16 lines 9-20). 

19. Regarding claim 3, Voorhies teaches: A method, in which the predetermined function is a 
multiplication by 0.5 (fig. 12, 1525 see also col. 16 lines 16-19). 

20. Regarding claim 4, Voorhies teaches: A method, in which the one-to-one correspondence 
of a map point with the direction of a vector through the map origin represents a projection onto 
a predetermined plane of a point on the vector which is a predetermined distance from the map 
origin (fig. 6). 

21 . Regarding claim 5, Voorhies teaches: A method, in which the predetermined plane is a 
plane orthogonal to the viewing direction vector (fig. 6). 

22. Regarding claim 6, Voorhies teaches: An image rendering method comprising the steps 
of: generating a two dimensional map of a three dimensional environment (fig. 4, 512); for a 
point of interest on an object to be displayed, deriving a reflection vector in dependence on a 
normal vector at the point of interest and a direction of view (fig. 4, 5 10); referencing a position 
in the two dimensional map using the reflection vector, to detect environmental properties at that 
map position (fig. 6). 

23 . Voorhies doesn't teach: varying the appearance of the object at the point of interest in 
dependence on the detected environmental properties. 

24. The analogous prior art Cerny teaches: varying the appearance of the object at the point 
of interest in dependence on the detected environmental properties (fig. 4, 430) for the benefit of 
to implement a system and method of environment mapping that depends upon an observer's 
location with respect to an object's location and orientation to generate a more realistic reflection 
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pattern, and that is consistent with results of the direct normal projection method for particular 
object-observer geometries. 

25. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine varying the appearance of the object at the point of interest in dependence 
on the detected environmental properties as shown in Cerny with Voorhies for the benefit of to 
implement a system and method of environment mapping that depends upon an observer's 
location with respect to an object's location and orientation to generate a more realistic reflection 
pattern, and that is consistent with results of the direct normal projection method for particular 
object-observer geometries. 

26. Regarding claim 7, Voorhies doesn't teach: A method, in which the varying step is 
performed in dependence on a reflectivity of the object at the point of interest. 

27. The analogous prior art Cerny teaches: A method, in which the varying step is performed 
in dependence on a reflectivity of the object at the point of interest (fig. 4, 430) for the benefit of 
to implement a system and method of environment mapping that depends upon an observer's 
location with respect to an object's location and orientation to generate a more realistic reflection 
pattern, and that is consistent with results of the direct normal projection method for particular 
object-observer geometries. 

28. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the varying step is performed in dependence on a reflectivity of the object 
at the point of interest as shown in Cerny with Voorhies for the benefit of to implement a system 
and method of environment mapping that depends upon an observer's location with respect to an 
object's location and orientation to generate a more realistic reflection pattern, and that is 
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consistent with results of the direct normal projection method for particular object-observer 
geometries. 

29. Regarding claim 8, Voorhies doesn't teach: A method in which the environmental 
properties represent lighting properties. 

30. The analogous prior art Cerny teaches: A method in which the environmental properties 
represent lighting properties (fig. 4, 415) for the benefit of to implement a system and method of 
environment mapping that depends upon an observer's location with respect to an object's 
location and orientation to generate a more realistic reflection pattern, and that is consistent with 
results of the direct normal projection method for particular object-observer geometries. 

31. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the environmental properties represent lighting properties as shown in 
Cerny with Voorhies for the benefit of to implement a system and method of environment 
mapping that depends upon an observer's location with respect to an object's location and 
orientation to generate a more realistic reflection pattern, and that is consistent with results of the 
direct normal projection method for particular object-observer geometries. 

32. Regarding claim 9, Voorhies doesn't teach: A computer-readable medium having 
instructions stored therein which when executed, cause a computer to perform the method. 

33. The analogous prior art Cerny teaches: A computer-readable medium having instructions 
stored therein which when executed, cause a computer to perform the method (fig. 2, 210) for the 
benefit of to implement a system and method of environment mapping that depends upon an 
observer's location with respect to an object's location and orientation to generate a more realistic 
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reflection pattern, and that is consistent with results of the direct normal projection method for 
particular object-observer geometries. 

34. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine computer-readable medium having instructions stored therein which when 
executed, cause a computer to perform the method as shown in Cerny with Voorhies for the 
benefit of to implement a system and method of environment mapping that depends upon an 
observer's location with respect to an object's location and orientation to generate a more realistic 
reflection pattern, and that is consistent with results of the direct normal projection method for 
particular object-observer geometries. 

35. Regarding claim 13, Voorhies teaches: Apparatus for forming a two dimensional map of 
a three dimensional environment, there being a map origin located in the three dimensional 
environment, a viewing direction vector defined passing through the map origin, and a one-to- 
one correspondence between map positions in the map and the directions of vectors passing 
through the map origin; the apparatus comprising: means for associating an environment position 
in the three dimensional environment with a folded vector that passes through the map origin, the 
folded vector lying in a plane containing both the viewing direction vector and the environment 
position and forming an angle with the viewing direction vector that is a predetermined function 
of the angle between the viewing direction vector and a vector between the map origin and the 
environment position (fig. 9); and means for deriving properties for a map position from the 
properties of the corresponding environment position (fig. 6 see also col. 12 lines 13-31). 
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36. Voorhies doesn't teach: means for associating an environment position with the map 
position corresponding to the direction of the folded vector associated with that environment 
position. 

37. The analogous prior art Cerny teaches: means for associating an environment position 
with the map position corresponding to the direction of the folded vector associated with that 
environment position (fig. 3 see also [0030]) for the benefit of to implement a system and 
method of environment mapping that depends upon an observer's location with respect to an 
object's location and orientation to generate a more realistic reflection pattern, and that is 
consistent with results of the direct normal projection method for particular object-observer 
geometries. 

38. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine means for associating an environment position with the map position 
corresponding to the direction of the folded vector associated with that environment position as 
shown in Cerny with Voorhies for the benefit of to implement a system and method of 
environment mapping that depends upon an observer's location with respect to an object's 
location and orientation to generate a more realistic reflection pattern, and that is consistent with 
results of the direct normal projection method for particular object-observer geometries. 

39. Regarding claim 14, Voorhies teaches: An image rendering apparatus comprising: map 
generating apparatus (fig. 3, 410); means for deriving a reflection vector, in respect of a point of 
interest on an object to be displayed, in dependence on a normal vector at the point of interest 
and a direction of view (fig. 4, 5 1 0); means for referencing a position in the two dimensional 
map using the reflection vector, to detect environmental properties at that map position (fig. 6). 
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40. Voorhies doesn't teach: means for varying the appearance of the object at the point of 
interest in dependence on the detected environmental properties. 

4 1 . The analogous prior art Cerny teaches: means for varying the appearance of the object at 
the point of interest in dependence on the detected environmental properties (fig. 4, 430) for the 
benefit of to implement a system and method of environment mapping that depends upon an 
observer's location with respect to an object's location and orientation to generate a more realistic 
reflection pattern, and that is consistent with results of the direct normal projection method for 
particular object-observer geometries. 

42. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine means for varying the appearance of the object at the point of interest in 
dependence on the detected environmental properties as shown in Cerny with Voorhies for the 
benefit of to implement a system and method of environment mapping that depends upon an 
observer's location with respect to an object's location and orientation to generate a more realistic 
reflection pattern, and that is consistent with results of the direct normal projection method for 
particular object-observer geometries. 

43. Regarding claim 15, Voorhies doesn't teach: A video game machine comprising 
apparatus. 

44. The analogous prior art Cerny teaches: A video game machine comprising apparatus (fig. 
2, 200) for the benefit of to implement a system and method of environment mapping that 
depends upon an observer's location with respect to an object's location and orientation to 
generate a more realistic reflection pattern, and that is consistent with results of the direct normal 
projection method for particular object-observer geometries. 
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45. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine video game machine comprising apparatus as shown in Cerny with 
Voorhies for the benefit of to implement a system and method of environment mapping that 
depends upon an observer's location with respect to an object's location and orientation to 
generate a more realistic reflection pattern, and that is consistent with results of the direct normal 
projection method for particular object-observer geometries. 

Conclusion 

46. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MAURICE MCDOWELL, JR whose telephone number is 
(571)270-3707. The examiner can normally be reached on Mon-Friday 7:30am - 5:00pm 
Eastern Time. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Xiao Wu can be reached on 571-272-7761. The fax phone number for the 
organization where this application or proceeding is assigned is 57 1 -273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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ABSTRACT 



An apparatus for generating a reflection from a three- 
dimensional environment map. The apparatus includes a 
reflection vector generator which receives an eye vector and 
a normal vector neither of which need be normalized. This 
reflection vector generator generates a reflection vector 
without vector normalization. The reflection vector genera- 
tor then couples to a decoder to supply the generated 
reflection vector. The decoder, in turn, determines a location 
where the reflection vector indexes the selected 
2-dimensional map which forms part of the environment 
map. 

19 Claims, 12 Drawing Sheets 
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METHOD AND AN APPARATUS FOR then has to be convolved with the hemispherical ffluminat- 

GENE RATING REFLECTION VECTORS ing scene visible from the particular surface point corre- 

WHICH CAN BE UNNORMALIZED AND sponding to the reflectance function. Unfortunately, these 

FOR USING THESE REFLECTION VECTORS calculations of the bi-directional reflectance functions and 

TO INDEX LOCATIONS ON AN 5 the hemispherical convolutions are computationally unreal- 

ENVTRONMENT MAP izable for real-time reflection rendering systems. 

BACKGROUND OF THE INVENTION Consequently, prior art computer graphic systems employ 

gross approximations, such as point tight source and mirror 

1. Field of the Invention reflection approximations, in order to incorporate surface 
The present invention relates to the field of computer 10 reflections in their models. However, even after using these 

graphics, and particularly to a method and an apparatus for approximations to model surface reflections, these prior art 
generating reflection vectors which can be unnormalized and computer graphic modeling techniques have been unable to 
for using these reflection vectors to index locations on an render rich surface reflections at real time speeds, 
environment map. 

2. Description of the Related Art 15 A. Point Light Source Models 

Interactive computer graphics systems have been widely Point light source approximation models use a variation 
used mmdustrial design for the modeling, visualization, and of the following Rumination equation to represent an 
manufacture of complex surfaces such as automobile bodies. object's surface reflection intensity I: 
A three-dimensional image is represented in a computer 2Q 

graphics system as a collection of three-dimensional geo- (i) 
metric pimitives (Le., three dimensional objects), which are " isfsn /x 

denned in a three-dimensional world coordinate system 

Each three-dimensional geometric prinritive is composed of = f \«^+z (W+z,^], 

a number of geometric entities, such as character strings, ^ laX5« t i£/5m J 

points, straight lines curved tines, and filled areas where (1) X represents a wavelength of tight, such as red, 
(polygons, circles, etc.). For instance, geometric primitives &cc% or blue, (2) ^ 0 is the intensity of the reflected light, 
are commonly represented by polygon meshes, which are (3) is me intensity of the ambient light component, 

sets of connected, polygonaUy bounded planar surfaces (4) t ^ fa of dmgc re flectioV tight 

(such as mangles or quadrilaterals). M com $££ for each point tight source j, and (5) l^Jis 

In addition, often for each graphical primitive, a computer the intensity of the specular reflection component for each 
system stores corresponding attributes, which describe how point light source j. The ambient light component is used to 
the particular primitive is to be displayed. Common model reflections of non-directional sources of light which 
attributes that are stored by computer systems are color uniformly muminate a computer generated object The 
specifications, line styles, and text styles. The attributes and 35 ambient light component is represented by the following 
the geometric entities of the geometric raimitives are then equation: 
used to render the primitives on a two-dimensional display 
device, which is composed of a number of pixels whose 

coordinates are defined relative to a two-dimensional display I^^^W^O^ 
device coordinate system This process for transforming a 40 

collection of three-dimensional graphical objects into two- where (1) is the intensity of the ambient light which is 
dimensional displayed images is called rendering. Literally, constant for all objects, (2) K a is an object's ambient- 
the rendering process takes three-dimensional object infor- reflection coefficient which determines the amount of ambi- 
roation and converts it to two-dimensional pixel represen- cnt reflected from the object's surface, and (3) O^ is 
tation of the object 45 mc object's diffuse color. 

One attribute that computer graphic systems have long 111 addition, m ^der to represent an object's surface 
sought to incorporate into their computer graphic models are reflections due to directional point light sources, computer 
surface reflections. Surface reflections are useful for apprais- graphic systems incorporate the diffuse and specular reflec- 
ing the smoothness and the curvature of complex surfaces as ^ chamcteristics of 811 <****• HG - 1 presents a vector 
surface reflections are the classic way humans perceive 50 dia ^ am ^ fthe dufuse and specular reflection characteristics 
surface shapes. More specifically, because for both real-life of directional point light sources. The diffuse reflection 
and computer generated objects a viewer best observes an component (1^^*) represents a directional point tight 
object's surface characteristics (i.e., the surface smoothness source ' s reflections from a surface mat are scattered with 
and curvature) when the object's surface richly reflects light cqud intensitv m all directions independent of the viewing 
(i.e., the object is shiny) and the viewer moves interactively 55 ^ ectioa 1x1 other words ' toe reflection component of 
with respect to the object, computer graphic systems have ^ reflected ^8** appears equally bright from all the view- 
long sought to produce rich surface reflections at real time ing angles andhas its brightness dependent only on the angle 
speeds (i.e., at speeds that allow the viewer to move inter- ®J bctwc€n ^ source J direction vector L y and surface 
actively with respect to the object). normal vector N. The diffuse reflection component is rep- 

However, rendering geometric primitives with rich sur- 60 rCSCntcd * foUowi *g 
face reflections at real time speeds has been an elusive goal 

for reflection rendering hardware. To correctly model the x , Kj0 ^ e 

optical physics would require the evaluation of a ^*"* A ^ ^ 

bi-directional reflectance function at each displayed point of where ( 1) X represents a wavelength of light, such as red, 

the computer generated model (i.e., at each point of the 65 green, or blue, (2) 1^ is the intensity of point tight source 

geometric primitives that is represented by a pixel on the j, (3) K^is the object's material diffuse-reflection coefficient 

display device). Each bi-directional reflectance function (4) 0 A is the object's diffuse color, and (5) ^ represents the 
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angle between light source j direction vector L y and surface More specifically, when a curved surface is approximated by 

normal vector N (as shown in FIG. 1). When light source a polygon mesh and each polygon facet in the mesh is 

direction vector L y and surface normal vector N are shaded individually through interpolation, each polygon 

normalized, cos 8, equals the dot product between these two facet may be easily distinguishable from its neighbors whose 

vectors. 5 orientations are different, because adjacent polygons of 

Prior art computer graphic systems further model the different orientation may have different intensity derivatives 

surface reflections due to directional point light sources by along their border. When computer graphic systems incor- 

iocorporating the specular reflection characteristics of an porate Gouraud shading, the lateral inhibition of the recep- 

object The specular reflection component (J fpeculat p) incor- tors in the eye exaggerates the intensity change at any edge 

porates into the point light source lighting model the high- io where there is a discontinuity in the slope of the intensity 

lights (Le., bright spots) that light sources create on an (i.e., creates Mach banding effect). Thus, linear intensity 

object Specular reflections are the result of reflection of interpolation is inappropriate where the surface lighting has 

incident light in a concentrated region. The specular reflec- high second derivatives (such as near the edge of specular 

tion angle is the angle formed by the specular-reflection highlights) because such surfaces must either be tessellated 

vector SR y and surface normal vector N, and is equal to the 15 so finely that linear intensity interpolation loses its perfor- 

angle between light source direction vector L y and surface mance advantage or be left more coarsely tessellated and 

normal vector N. rendered with faceted highlights and obvious Mach bands. 

One manner of representing the specular reflection com- Another prior art point light source reflection modeling 

ponent l tp ^ cu4arfl , is set forth by the following equation: technique is the Phong shading model. This shading tech- 

20 nique is a more accurate method for rendering surface 
reflections on a computer generated object, because this 

^^a^a 1 ^ 0 * a / shading model linearly interpolates each normal vector at 

where (1) k represents a wavelength of light, such as red, f<*P** *f« ***** mte^l^ed norroal vetoes to 

green, or blue, (2) \ PJk is the intensity of point light source ^ G •« * TTV* ^ pa f L 

j, (3) K, is the object's material specular-reflection 25 More specificaUy, the Phong shading model renders a poly- 
coefficient, (4) 0 A is the object's specular color, (5) ou is the gon surface by carrymg out the following ; steps: (1) ascer- 

angle between the reflection veciorSR, and the viewing H ttmn ? umt t n ?™? vector * ***** < 2 > 

direction vector E (as shown in FIG. 1), and (6) n represent «**P*^ the vertex normals over the surface of 

mernateriaTsspecularrefl^ ( ? aPpiy ^ g ^J™* 10 ? f ^ 
is proportional tol ihe shininess of m^bject If me dkection 30 men ^ illumination equation (i) to calculate projected 
of reflection vector SR, and viewpoint direction vector E are pULei m ^ nsit J es f or surf ^ P° mts ' calculations 
normalized, then cos a, equals the dot product of these usm £ ?^ kfe ? d ° ormal v f ct . Qrs ^ce more accurate 
normalized vectors. Furthermore, reflection vector SR. can ^ ^2*?* ^J?° moa °f mt f nsi £ values < as m 
be derived from direction of light vector L, and surface * C ??™™ d g) ' C™^™****™™* shad f 8 
normal vector N. More specifically, when surface normal 35 ^el^spiays j more realistic ^sr^ular ^ghhghts on a poly- 
vector N and direction of light vector L, are normalized, the g °° SU ^f w^ejeducmg the Mach banding effects, 
mirroring of L, about N results in the reflection vector The trade-off, however, is that Phong shading requires 
having a value 2*N*(N^>-L, Consequently, if surface CXt f ns "? <fc«lations per pixe and per light source, which 
normal vector N, direction of light vector L„ and viewpoint *» modcl sloW Jj rendenn 8 interesting 
direction vector E are normalized, then 40 surface reflections in real time. This prevents the use of 

Phong shading for interactive computer graphics. More 
specifically, Phong shading is much more computationally 

cos a/z(2*N*(N-Lj}-LjyE. intensive than Gouraud shading because Phong shading 

requires that each interpolated normal vector (N) to be 

One example of a prior art point light source reflection 45 normalized. In turn, the normalization of the normal vector 

modeling technique shades a polygon surface by linearly (N) reduces the speed of Phong shading because normaliz- 

interpolating intensity values across the surface of the poly- ing a vector involves an inverse square root function, which 

gon. More specifically, under this approach, each polygon cannot be inexpensively implemented by hardware, 

surface is shaded by performing the following operations: In addition, the inverse square root function necessary for 

(1) ascertaining the unit normal vector at each polygon 50 normalizing a vector is expensive if higji precision is 

vertex, (2) applying a variation of the above-mentioned required; if this function is approximated by using a table 

iUurnination equation (i) to each vertex to calculate the lookup technique any errors will be magnified mercilessly 

vertex intensity, and (3) performing Gouraud shading by by subsequent specular exponent calculation. Furthermore, 

linearly interpolating the vertex intensities over the surface in order to perform Phong calculations in hardware, the 

of the polygon. The Gouraud shading technique is not 55 cosine raised to a power function (which is used for calcu- 

relatively computationally intensive because it requires nor- lating the specular reflection component) is a precision 

malization operations to be performed only at each vertex. nightmare. Also, performing Phong calculation by hardware 

Consequently, this prior art shading model can be used to is problematic because the cos* a y calculation must be 

render specular reflections at real time speeds because it can repeated for every light source, which makes the perfor- 

be implemented by hardware (as it is not computationally 60 mance of the Phong shading hardware dependent on the 

intensive). number of light sources. This dependence on the number of 

Unfortunately, there are several disadvantages for render- point light sources is especially problematic when approxi- 
ing specular reflections by using Gouraud shading. For mating area lights, 
instance, the Gouraud shading technique (i.e., linear inten- 
sity interpolation technique) is a poor choice for rendering 65 B * MilTQr Reflection Approximation Models 
surface highlights because it accentuates the polygonal Two examples of surface reflection modeling techniques 
nature of the model and introduces Mach banding effects. that use mirror reflection approximation models are ray 
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tracing techniques and environment mapping. Ray tracing 
determines surface reflections by tracing imaginary rays of 
light from the viewer's eye to the objects in the scene. The 
basic ray tracing algorithm first sets up a center of projection 
(Le., the view from the eye) and a window on an arbitrary 5 
view plane. The window is divided into a regular grid whose 
elements correspond to pixels at the desired resolution. 
Then, for each pixel in the window, an eye ray is fired from 
the center of projection through the pixel's center into the 
scene. Illumination effects accumulated along this ray *s path 10 
are then assigned to the pixel. The basic ray tracing algo- 
rithm also provides for visible-surface detection, shadow 
effects, transparency, and multiple light source illumination. 
For example, to calculate shadows, an additional ray is 
transmitted from the point of intersection to each of the light 
sources. If one of these shadow rays intersects an object 
along the way, then the object is in shadow at that point and 
the shading algorithm ignores the contribution of the shadow 
ray's light source. 

Ray traced displays can be highly realistic, particularly 
for shiny objects, but they require considerable computation 
time to generate. More specifically, even if the number of 
reflections is limited to five or ten reflections, ray tracers 
have fundamental problems that make them unrealizable for 
real time rendering hardware. For example, since ray tracing 
accounts for the local three-dimensional position of reflected 
objects, ray tracing algorithms are extremely costly and 
slow. Each reflected ray probes surrounding objects, which 
multiplies the already high intersection testing load and 
makes rendering time not linear with complexity. 

Surface reflections can also be rendered by environment 
mapping, which is an alternative procedure for modeling 
global reflections by (1) defining an array of intensity values 
that describe the environment surrounding the rendered 
three-dimensional object, and then (2) projecting these 
intensity values in relationship to a viewing direction onto 
the graphical primitives that form the image. Information in 
an environment map includes intensity values from sources 
such as light sources, the sky, or other background objects. 

An environment map contains a representation of the 
outside world as viewed from a single point, with the 
simplifying assumption that the outside world is infinitely 
far away. Thus an environment map M is indexed only by 
the reflection direction. This indexing does not communicate 
the distance between the object and the environment. 
Furthermore, typically environment mapping algorithms 
presume that other objects in the three-dimensional image 
do not obscure the projection of the environment onto a 
particular object 

To render surface reflections for an object, reflection 
vectors are first computed for all displayed points of the 
geometric primitives (i.e., for all geometric primitives' 
points that are represented by pixels on the display device). 
A reflection vector can be derived for a particular displayed 
point P (which is represented by a corresponding pixel on 
the display device) of a geometric primitive by mirroring the 
eye (Le., viewpoint direction) vector E about the surface 
normal vector N at point P. If surface normal vector N and 
eye vector E are normalized, the mirroring of E about N 
yields the following equation for the reflection vector: 

te2*N H *(N„-E n y~E nt (ii) 

where the subscript "n" denotes that the vector is normal- 
ized. 

This reflection vector is then used to index (i.e., to 
reference) a location on environment map M. Conventional 
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texture mapping techniques then can be employed to impose 
on the pixel representing displayed point P the two- 
dimensional image that is obtained at the indexed location in 
the environment map. For example, the intensity of the 
reflected light at the pixel corresponding to point P can be 
determined by averaging the intensity values within the 
indexed region of the environment map. Anti-aliasing also 
can be incorporated into the environment mapping model by 
filtering some number of intensity values surrounding the 
indexed location in the environment map. 

Environment mapping avoids the performance shortcom- 
ings of ray tracing because environment mapping makes 
several approximations. For example, because environment 
maps represent an outside world at infinity, they are an 
arbitrary function of direction alone and ignore parallax (le., 
ignore the position of an object relative to the center of the 
environment in determining the location to sample on the 
environment map). Ignoring parallax dramatically simplifies 
the calculation of the index into the map. Thus, the envi- 
20 ronment map may be pre- computed since it is the image of 
the environment as viewed from a single reference point 

One implementation of environment mapping in the prior 
art involves the computation of a normalized eye vector E 
and a normalized surface normal vector N for each pixel on 
25 the object to determine a reflection vector R which is used 
to index a location on one of 6 faces of a cubic environment 
map. A cubic environment map can be created by taking six 
pictures of the environment that surrounds an object with a 
wide angle camera that has a horizontal and vertical view of 
30 90°. These environment maps are then often stored as 6 
2~dimensional maps in texture map storage. This implemen- 
tation is performed in software and very slowly produces, 
even on fast hardware, good, distortion-free results. This 
prior art environment mapping technique is slow because 
35 each E and N vector at each displayed pixel must be 
normalized in order to generate a reflection vector R at each 
pixel based on the prior art equation (ii), and the normal- 
ization process is computationally intensive and hence slow. 
The results are good because the calculations are performed 
40 for all displayed pixels without linear interpolations between 
vertices of a polygon. Thus, while the results are good, the 
slowness of this implementation precludes its use for real 
time, interactive uses of environment mapping. 

A faster alternative implementation of environment map- 
45 ping uses interpolation from the reflection vectors at the 
vertices of the geometric primitive rather than calculating 
normalized reflection vectors at each displayed pixel of the 
primitive. In this approach, described in Haeberii, P. and 
Segal, M., a Texture Mapping as a Fundamental Drawing 
50 Primitive, Proc. Fourth Eurographics Workshop on 
rendering, Paris, France, June 1993, pp. 259-266, a normal- 
ized reflection vector is generated, using the prior art 
approach of equation (ii) above, at each vertex of a polygon. 
That is, normalized E and a normalized N vectors are 
55 computed only for the vertices of the polygon and then 
normalized R vectors are computed for only the vertices. 
These R vectors at the vertices are then used to index the 
environment map. In this implementation, the environment 
map is also a cubic environment map, and each reflection 
60 vector from the particular vertex indexes a location on one 
of the six faces of the cubic environment map unless the 
polygon has reflections onto 2 (or more) different faces of 
the cubic environment map. If this reflection onto 2 or more 
faces occurs, then the polygon is subdivided into 2 or more 
65 polygons, each of which projects only onto a single face of 
the cubic environment map, and the reflection vectors for 
each vertex of each subdivided polygon are used to index 
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into the selected face of the map. For displayed pixels of the It can be seen from mis discussion that while some 

polygon which are not at the vertices, the reflection vector implementations of environment mapping yield good, 

for each such pixel is determined from interpolation (usually distortion-free results but are slow, other implementations 

linear) of the reflection vectors at the vertices. The use, in are faster, allowing real-time interactivity, but at the expense 

this implementation of environment mapping, of interpola- 5 of distorted reflections and, in the case of circular environ- 

tion speeds up the processing required to produce an image ment maps, a fixed viewer, and, in the case of cubic 

with reflections from an environment map because environment maps with interpolation, polygon subdivision, 

normalization, although required for some pixels, is only ItwiUbear^eciatedthatitisdesfraW 

required for the vertices of displayed polygons. However, graphics having fast, real-time, interactive reflection shading 

the use of interpolation introduces distortion into the reflec- io of objects without distortion, without polygon subdivision 

tions produced by this technique; this is because the indexes and with a moveable viewer, 

too the environment map ^n^y intopolaled tetw«n SUMMARY OF THE INVENTION 
the vertices and Unear interpolation does not accurately 

correspond to the angular change in the reflection vector The present invention provides a method and an apparatus 

across a polygon. These distortions can make the image is for generating reflection vectors without vector normaliza- 

appear less realistic. Another disadvantage of this technique tion and for using these reflection vectors to index a three 

is that subdivision of polygons -is necessary when the dimensional environment map. 

reflections project onto 2 or more faces; this subdivision also in one en&odiment, the present invention provides a 

requires computation time and complicates the environment method for generating a reflection vector that indexes a 

mapping process. Thus while this technique requires less 20 three-dimensional environment map. This method com- 

normalization and is faster than the first environment map- prises the steps of (1) receiving an eye vector and a normal 

ping technique described above and allows the viewer to be vector neither of which need be normalized, (2) producing 

movable, this technique suffers from distortion in the reflec- a reflection vector without vector normalization, and (3) 

tions (producing distorted images) and requires polygon determining the location where the reflection vector indexes 

subdivision. 25 the three-dimensional environment map. 

Yet another implementation of environment mapping uses In accordance with another aspect of the present 

a circular environment map and has been descried in Hae- invention, an apparatus is provided for generating a reflec- 

berli and Segal, supra at page 264. Also see, e.g. FIG. 1 at ^ 0Q vector that indexes a three-dimensional environment 

page 164 in Voorhies, D. and Foran, J., Reflection Vector map -phe apparatos includes a reflection vector generator for 

Shading Hardware, Computer Graphics Proceedings, SIG- 30 reviving an eye vector and a normal vector neither of which 

GRAPH 94, pages 163-166 (1994). In this implementation, nec(i ^ normalized This reflection vector generates a 

a single circular environment map is indexed by a normal- reflection vector without vector normalization. The reflec- 

ized reflection vector at each vertex of the polygon, and the tion vector generator then couples to a decoder to supply the 

reflection vector indices for the remaining pixels of the generated reflection vector. The decoder, in turn, determines 

polygon are interpolated between me indexes at the vertices 35 a location where the reflection vector indexes the three- 

of the polygon. Since there is only one map, a polygons dimensional environment map and in turn, a light shading 

reflections cannot project onto different faces and conse- va | ue ^ retrieved from the three-dimensional environment 

quently polygon subdivision is not necessary; this improve- ^ which is typically stored in random access memory, 

ment makes the process faster and less compUcated While interpolation between map indexes at polygon vertices is 

sorne noimahzahon is required, it is not done for all pixels 40 unncc€Ssar y because the reflection vector can be computed 

and thus this implemeDtation is relatively fast; in fact, it is at ^ since &e computationally intensive process of 

fast enough to be considered practical for some real tune, nonna j^ tioil is not ncC essary at all. Consequently the 

interactive computer graphics. invention does not produce distorted reflections in computer 

Unfortunately this implementation with a circular map ^ ^ and moreovcr there is no need for polygon 

has several disadvantages. First, some nonnalizaUon is still 45 su5division since ±c of me 2 -dimensional map 

required Furthermore, indexing a circular texture map is selected b a re£(ection vector is made for each pixe l of a 

correct only for rendering with a fixed viewer. This latter . Moreover ^ inventio n allows for a moveable 

limitation is a poor match to emulating the physical inspec- vi lowing realistic, fast, real-time interactive com- 

tion of a car body, for example, where the viewer walks „^ cs with ricfa shadmgs . 

around a stationary car. Virtual reality devises such as the so 

stereoscopic boom emphasize this natural "inspection" BRIEF DESCRIPTION OF THE DRAWINGS 

paradigm, where the object and environment stay fixed nG t set§ forth a vectof ^ &3m of an object , s dffi|sc 

while the viewer roams at will, ^tering the eye position &n& reflectioil characteristics due to directional 

requires creation of a new map, which is challenging to do . t sources 

in real time. Thus, this implementation is not practical for 55 ~ / ... 

most real time, mteractiv7computer graphics. 2 presents a computer system upon which one 

Interpolation within a ckctflar map also has two severe embodiment of the present invention is implemented, 

artifacts. Grazing reflections map to points near the FIG. 3 presents one embodiment of the reflection vector 

perimeter, but they are extremely sensitive to object nor- shadm * of I* esent invention, 

mals. A tiny object rotation can result in a vertex texture 60 mG ' 4 presents another embodiment of the reflection 

index snapping to the opposite side of the map. Secondly, vector shading method of the present invention, 

linear texture index interpolation in this 'reflection-in-a- FIG. 5 presents yet another embodiment of the reflection 

sphere" circular map causes severe distortion of the vector shading method of the present invention, 

reflection, especially for near-grazing reflections. Although FIG. 6 presents a vector diagram of the generated reflec- 

there is sufficient resolution and minimal distortion at the 65 tion vector of the present invention indexing a cubic envi- 

center of the map, the periphery may be very distorted and ronment map which is aligned with the axis of the coordinate 

the mapping extremely anisotropic. system. 
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FIG. 7A presents one type of octahedron map whose frame buffer 350. It should be noted that alternative embodi- 

surface coordinates are described by IXWYI+!ZI=1. FIGS. raents of graphics subsystem 355 embody frame buffer 350. 

7B and 7C present the eight faces of me octahedron unfolded One embodiment of graphics subsystem 355 includes a 

into a square to match conventional texture mapping hard- storage means (e.g. a Dynamic Random Access memory 

ware. 5 (DRAM)) for storing one or more environment maps. 

FIG. 8 presents still another embodiment of the reflection subsystem 355 could further include r*ocessing 

vector shading method of the present invention. Jf*!^ ^ rfoTmmg P*^*™ tex ^ e ma fP m ^ 

n . (for performing per pixel divisions) during the rendering 

FIG. 9 presents a vector diagram of the generated reflec- process. The graphics subsystem 355 would further include 

tion ^ vector of the present invention indexing an octahedron processing elements for transforming between coordinate 

environment map which is aligned with the axis of the systems and for performing other processing needs of the 

coordinate system present invention. 

FIG. 10 presents a block diagram for one embodiment of The rendering process of the present invention begins by 

a reflection vector generating apparatus of the present inven- the processor 310 providing graphics subsystem 355 with 

tion. . the visual description of three-dimensional objects in the 

FIG. 11 presents one embodiment of a reflection vector scene bein S readered - ™ s visual description takes the form 

generator used in the reflection vector generating apparatus f <lrawmg commands and world* coordinate vertex data for 

of FIG 10 the geometric entities that form the geometric primitives of 

the image. The world coordinate system is the coordinate 

FIG. 12 presents an embodiment of the decoder used in system ^ which ^ three-dimensional objects are described, 

the reflection vector generating apparatus of FIG. 10. 20 The world cc<jrdinate vertex data describes the object's 

geometric position, color, and surface normal vectors. The 

DETAILED DESCRIPTION OF THE graphics subsystem 355 then performs transformations and 

INVENTION other graphics operations to calculate specific pixel values 

Hiepresentinvention provides a method and an apparatus for of 1*"* on **** m 

for generating reflection vectors which can be unnormalized 25 A In one embodiment of graphics subsystem 355, the object 

(i.e., can have non-unit lengths) and for using these reflec- W me processor is processed in afour stage pipehne 

f ^ - i^Jt„„ ' „^ * ^ M T „ before being displayed on the screen. These four pipeline 

tion vectors to mdex locations on an environment map l In * 'c^mstry Subsystem 2) a Scan^Con- 

the foUowing description for purposes of explanation version Subsystem, 3) a Raster Subsystem, and 4) a Display 

numerous Retail* >are set forth m order to r^ovide a thorough Subsystem. Hie Geometry Subsystem receives the graphical 

understanding of the present invention. However, it will be ^ from ^0^0, to generate screen-space data, which 

understood by one of ordinary skill m the art that these define an object's positions in a screen coordinate system 

specific details are not required in order to practice the corresponding to the visible plane of the display monitor 

invention. In other instances, well-known electrical struc- screen. The Scan Conversion Subsystem then breaks down 

tures and circuits (such as adders, subtracters, multipliers, points, lines, polygons, and meshes to thereby produce pixel 

etc.) are shown in block diagram form in order not to data. One embodiment of the present invention is imple- 

obscure the description of the present invention with unnec- mented in the Scan Conversion Subsystem This pixel data 

essary detail. is sent to the Raster Subsystem where a z-buffer removes 

FIG. 2 presents a computer system upon which one nidden surfaces. The Raster Subsystem also performs vari- 

embodiment of the present invention is implemented. Com- ^ ™ s . «««jtog ™ d texturing functions on a pixel-by-pixel 

puter system 300 includes bus 305 for communicating ^sis as <£e pixels are wntto^ 

information. A processor 310 couples with bus 305 for P*^ Subsvstera * e *™ ^er and displays the 

nrocessine dieital data. Computer svstem 300 also includes ^ ™ a color monitor. Finally, it should be noted that any 

r*ocessing digital tfata. Comjmter system ^W also includes other co^^ for computer system 300 may be used in 

Random access memory (RAM) 315 coupledto bus 30S for conjimctio * ^ Ae ^ invention, 

storing mgitalda^ 45 FIG. 3 sets forth one general embodiment of the reflection 

by processor 310. Computer system ^ further includes a vector ^ of the present invention. As shown 

read only memory (ROM) 320 coupled to bus 305 for in ^ \ at ^ 4d5 ±c for a kt 

storing static information and mstrucuons for processor 310. p on a geomctric a three-component reflection 

In addition, mass data storage device 325, such as a mag- vector which ^ ^ unnormalized. At step 406, the corre- 

neucctek or an optical ^ w sp0 nding 2-dimensional (2-D) map is identified. This cor- 

may also be included m the system responding 2-D map is a portion of the environment map and 

Alphanumeric input device 335 (e.g., a keyboard) may corresponds to the direction of the reflection vector. At step 

also be coupled to bus 305 for communicating information 410, the three components of the reflection vector are 

and command selections to processor 310. An additional reduced to two components by only preserving the direction 

user input device which may be coupled to bus 305 is cursor 55 information of the reflection vector. Finally, at step 415, the 

controller 340. Input device 340 may take many different direction information of the reflection vector is used to 

forms, such as a mouse, a trackball, a stylus tablet, a ascertain the location in the corresponding 2-D map. This 

touch-sensitive input device (e.g., a touchpad), etc. Another direction information typically provides an address which is 

device which may be coupled to bus 305 is hard copy device usc d to index the corresponding 2-D map at the indexed 

345 which may be used for printing a hard copy on paper. & location. This indexed location on the 2-D environment map 

Computer system 300 further includes a display device can then be supplied to conventional texture mapping algo- 

330, such as a cathode ray tube (CRT) or a liquid crystal rithms or devices, which then determine the surface shading 

display (LCD), for displaying information to a computer attributes for the pixel representing displayed point P on the 

user. Display device 330 couples to bus 305 via frame buffer display device. For example, the texture mapping device 

350, which stores the pixel data for driving the display 65 could determine the pixel shading attributes by averaging 

device 330. This stored pixel data is generated by graphics the intensity values within the indexed region of the envi- 

subsystem 355, which is coupled to both processor 310 and ronment map. 
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FIG. 4 sets forth one embodiment of the reflection vector the largest coordinate of the reflection vector and the sign of 

generation method of the present invention. As shown in this this coordinate indicate the face of the map that the reflection 

figure, at step 505, an eye vector E and a surface normal vector indexes. Consequently, at step 615, the face of the 

vector N, for a graphical object's particular displayed point environment map that the reflection vector indexes is 

P (i.e., a point on the object that is represented by a pixel on 5 derived by (1) detennining the component of the reflection 

the display device), are received Both of these vectors can vector (Le., R^, and that has the largest magnitude, 

be unnormalized and in the preferred they are both unnor- and (2) detennining the sign of this largest component At 

malized in order to avoid the computations involved in step 620, the location where the reflection vector indexes the 

obtaining normalized vectors. At step 510, a reflection referenced face of the map is deduced by dividing the two 

vector is produced. This reflection vector is an unnormalized 10 smaller components of the reflection vector by the magni- 

vector when either the normal vector or the eye vector is tude of the largest component This dividing step provides 

unnormalized. At step 512, the corresponding 2-dimensional two values which specify the indexed location. 

(2-D) map is identified. This corresponding 2-D map is a An example of steps 615 and 620 is shown in FIG. 6 

portion of the environment map and corresponds to the (which presents a vector diagram of a generated reflection 

direction of the reflection vector, At step 515, the compo- 15 vector of the present invention indexing a cubic environment 

nents of the reflection vector are reduced to two components map which is aligned with the axis of the coordinate 

to provide the 2-dimensional index values which are used to system). The reflection vector is represented by the coordi- 

locate, at the indexed location, the shading values in the nates 2.5, 1.0, -2.0, in this coordinate system. At step 615 a 

corresponding 2-D map. In step 520, at least one shading determination is made that the reflection vector indexes the 

value is obtained from the 2-D map at the indexed location. 20 x equals one face of the cubic environment map by (1) 

This shading value at the indexed location on the environ- determining that the x coordinate of the reflection vector has 

» ____ jj « 1 • » X , . • ... . ... - . _ 
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surface shading attributes for the pixel representing dis- indexed face in this case. At step 620, the and 

played point P on the display device. For example, the 25 components are divided by the magnitude of the R^ com- 

texture mapping device could determine the pixel shading ponent to determine the indexed location on the x equals one 

attributes by averaging the intensify values within the face of the environment map (which in this example is at 

indexed region of the environment map. y=0.4 and z=-0.8). The values for the indexed location on 

FIG. 5 sets forth a more detailed embodiment of the . the indexed face are then used in the conventional manner to 

present invention's method for generating reflection vectors retrieve the appropriate shading values from the indexed 

and for using these reflection vectors to index locations on face of the map. 

a cubic environment map which is aligned with the coordi- The indexed location on the selected 2-D map can then be 

nate system which specifies the reflection vector. As shown supplied to conventional texture mapping algorithms or 

in this figure, at step 605, an eye vector E and a surface devices, which then determine the surface shading attributes 

normal vector N, for a graphical object's particular dis- 35 for the pixel representing displayed point P on the display 

played point P(i.e., a point on the object that is represented device. For example, the texture mapping device could 

by a pixel on me display device), are received. Both of these, determine the pixel shading attributes by averaging the 

vectors can be unnormalized. At step 610, a reflection vector intensity values within the indexed region of the indexed 

is produced. This reflection vector is an unnormalized vector face of the 2-D map. 

when either the normal vector or the eye vector is unnor- 40 Gubic environment maps are not the only type of envi- 

malized. Moreover, this reflection vector is represented by ronment maps that can be used in the present invention. In 

three Cartesian coordinates R^ R^ and R,. In one embodi- fact, a three dimensional map consisting of any set of 2-D 

ment of the present invention, the reflection vector is pro- maps which cumulatively includes one and only one loca- 

duced by using the following equation: tion for every possible direction from the center of the 

45 environment could be used in the present invention, because 

MWWM ' " such a set of maps aUows a Utti q ue location on it to be 

• uniquely identified by a me direction of the reflection vector, 

which, as mentioned below, is derived from the prior art For example, as further discussed below by reference to 

equation (ii). FIG. 8, octahedron environment maps can be utilized in the 

As mentioned before, a cubic environment map can be so present invention. The use of 2-D maps is advantageous, 

created by taking six pictures of the environment that because two-dimensional images require far less storage 

surrounds an object with a camera. This cubic environment than three-dimensional volume tables, 

map is aligned with the world coordinate axes, so that the FIG. 7 A sets forth one type of octahedron map. This 

largest coordinate of a normalized reflection vector indicates octahedron map has vertices which lie on the Cartesian axes 

the appropriate side to index. Alternatively, a cubic envi- 55 and has its surface coordinates described by IXI-HYI-HZI=1. 

ronment map can be generated by the computer (1) by This map further has eight faces which differ from each 

selecting a center of projection, (2) rendering the objects in other in the signs of their x, y, and z cwjrdinates. For 

the computer generated environment for the six cube faces, example, all the points with positive x and negative y and z 

and (3) recording these images as the cubic environment which solve the above equation form one face. So given the 

map. The six faces of a cubic environment map (which are 60 sign bits of the three components of the reflection vector R^ 

selectively referenced by three-dimensional reflection Ry, and R a , a particular face of the octahedron can be 

vectors) can be stored as six. two-dimensional maps in selected Furthermore, if viewed orthographically along one 

conventional two-dimensional texture mapping hardware. of the coordinate axis, for example from +Y or from -Y, the 

As further shown in FIG. 5, at step 615, the 2-D map four visible faces in each case look like 45 -degree right 

containing the location corresponding to the direction of the 65 triangles, which can be indexed by their surface X and Z 

reflection vector is determined. Because the cubic environ- positions alone. Moreover, as shown in FIGS. 7B and 7C, 

ment map is aligned with the axis of the coordinate system the eight faces of the octahedron can be unfolded into a 
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square to match conventional texture mapping hardware, conventional two-dimensional mapping storage (as shown 

because these faces form 45-degree right triangles when in FIGS. 7B and 7C), the location where the reflection vector 

they are viewed orthographically. Thus, as set forth below in indexes me referenced face of the map is deduced by 

Table 1, the eight faces of the octahedron map to triangles in dividing the R x and IL components of the reflection vector 

a square environment texture map which has indexes s and 5 by the sum of the magnitudes of the reflection vector 

t- components (IRJ-HRyl-HRJ). 



TABLE 1 

X-fcvS C-to-T Z-to-T Z-to-S 



Face 


mapping 


IjjflipTTtnp 


mapping 


mapping 


1 -X>Y,+Z 


X = -1.0. . .0.0 




Z =-0.0 ... 1.0 






S ss 0.0 . . . 0.5 




T = 0.5 ... 1.0 




2 +X,+Y,+Z 


X = 0.0 . . . 1.0 




Z = 0.0 ... 1.0 






s = o*5 . : . i.o 




T = 0.5 . .'. 1.0 




3 -X,+Y,-Z 


X =-1.0 . , .0.0 




Z * -IjO . . . 0.0. 






S = 0.0 . . . 0.5 




T-0.0 . . .0.5 




4+X,+Y,-Z 


X = 0.0 . . . 1.0 




Z--1D...0X) 






S - 0.5 . . . 1.0 




T = OX) ... 0.5 




5-X,-Y,+Z 




X=-1j0 . . .0.0 




Z = 0X) ... . IX) 






T = 0J . . . 1X> 




S = 0.0 . . . 0.5 


6+X,-Y r +Z 




X = -0,0 . . . 1.0 




Z = 0.0 ... 1.0 






T « IX) . . . 0.5 




S = OX) ... 0.5 


7 -X,-Y,-Z 




X= 1.0... 0.0 




Z = -1.0...0.0 






T = 0.5 ... 0.0 




S = 0.5 . . . 0.0 


8 +X>Y,-Z 




X = 0.0 ... 1.0 




Z--1.0 ... 0.0 






T = 0.0 ... 0.5 




S = 0.5...1.0 



FIG. 8 sets forth another embodiment of the present 
invention's method for generating reflection vectors and for 
using these reflection vectors to index locations on an 30 
octahedron environment map which is aligned with the axes 
of the coordinate system which also determines the coordi- 
nate of the reflection vector. As shown in this figure, at step 
1005, an eye vector E and a surface normal vector N, for a 
particular displayed point P of a graphical object (i.e., a point 35 
on the object that is represented by a pixel on the display 
device), are received. Both of these vectors can be unnor- 
malized. At step 1010, a reflection vector is produced. This 
reflection vector is an unnormalized vector when either the 
normal vector or the eye vector is unnormalized. Moreover, 40 
this reflection vector is represented by three Cartesian coor- 
dinates R^ Ry, and R = . In one enibodiment of the present 
invention, the reflection vector is produced by using the 
following equation: 

which, as mentioned below, is derived from the prior art 
equation (ii). 

As further shown in FIG. 8, at step 1015 and 1020, the 50 
location where this generated reflection vector indexes (Le M 
where this reflection vector or its projection intersects) an 
octahedron environment map, which is aligned with the axes 
of the coordinate system, is determined. As mentioned 
before, the eight faces of an octahedron environment map 55 
differ from each other in the signs of their x, y, and z 
coordinates. Consequently, at step 1015, the face of the 
environment map that the reflection vector indexes is 
derived by exaniining the sign bits of the three components 
of the reflection vector R^ Ry, and R^. 60 

Furthermore, unlike cubic environment map projection 
which involves dividing the largest magnitude component 
into the other two, octahedron projection involves dividing 
the sum of the magnitudes of the components flRJ-HRj4+ 
IRJ) into two of the components. Thus, for the embodiments 65 
of the present invention which index an octahedron envi- 
ronment map by using x and z coordinates to reference a 



An example of steps 1015 and 1020 is shown in FIG. 9 
(which presents a vector diagram of a generated reflection 
vector of the present invention indexing an octahedron 
environment map which is aligned with the axis of the 
coordinate system). The reflection vector is represented by 
the coordinates 2.5, 1.0, -2.0. At step 1015 a determination 
is made that the reflection vector indexes face four of the 
octahedron environment map by examining the sign bits of 
the reflection vector components. At step 1020, the R x and 
R, components are divided by the magnitude of the sum of 
the reflection vector components (i.e., divided by 5.5) to 
determine the indexed location on face four of the environ- 
ment map (which in this example is at x=0.455 and 
z=-0364). Finally, at step 1025, the x and z coordinates are 
transformed into s and t coordinates to obtain the shading 
values for the referenced location of the octahedron envi- 
ronment map from the twchdimensional texture mapping 
storage. 

FIG. 10 sets forth one embodiment of the reflection vector 
shading hardware of the present invention. As shown in this 
figure, reflection vector shading hardware 1200 includes 
reflection vector generator 1205 and decoder 1210. In order 
to generate a reflection vector, reflection vector shading 
hardware 1200 receives an eye vector and a normal vector 
for an eye vector E and a surface normal vector N, for a 
particular displayed point P of a graphical object (i.e., a point 
on the object that is represented by a pixel on the display 
device). TTiis reflection vector is unnormalized when either 
the eye vector or the normal vector is unnormalized. As 
mentioned before, if the normal and the eye vectors are 
normalized, the reflection vector is represented by the fol- 
lowing prior art equation: 



Since a vector is normalized by dividing the vector by its 
length, this prior art equation (ii) can be replaced by the 
following equation: 



5,704,024 



15 



16 



Rn = 2* 



This transformation results in the multiplication of two !N1*s 
in the denominator, which equals (N-N ). Substituting (N-N) 
for !N)*INI yields: 



N*{N-E) E 



10 



But since the reflection vector R does not need to be 
normalized, both sides of the above equation can be multi- 
plied by !EI*(N-N), which results in the following equation: 



R = RS{N-N)*\E\ 



(iii) 



15 



Consequently, in one embodiment of the present 
invention, reflection vector generator 1205 uses the relation- 
ship set forth in equation (iii) to generate the reflection 20 
vector. By using equation (iii), reflection vector generator 
1205 can generate an unnormalized reflection vector by only 
using two dot products, two vector scaling operations, and a 
vector subtraction. 

FIG. 11 sets forth one embodiment of reflection vector 25 
generator 1205 of FIG. 10. As shown in FIG. 11, reflection 
vector generator 1300 can be implemented with a number of 
multipliers 1305, 1310, 1315, 1320, and 1325, a number of 
adders 1330 and 1335, and a subtracter 1340. First set of 
multipliers 1305 and adder 1330 generate the (N-E) com- 30 
ponent of equation (iii), while second set of multipliers 1310 
and adder 1335 generate the (N-N) component of equation 
(iii). Third set of multipliers 1315 and times two multiplier 



magnitude. The select logic unit 1510 also determines the 
sign of the reflection vector's component with the largest 
magnitude. Based on these determinations, select logic 1510 
(1) supplies a two-bit signal to multiplexor 1515 in order to 
cause mis multiplexor to identify the axis of this largest 
coordinate as the major axis, and (2) supplies a three-bit 
signal on line 1530, which identifies the indexed face of the 
cubic environment map, to conventional texture mapping 
hardware. 

Multiplexor 1515 then supplies the major axis coordinate 
to divider 1520 which produces the reciprocal of the input- 
ted major coordinate value. Based on a pre-determined 
relationship that is pre-programmed in the multiplexor, 
multiplexor 1515 then defines the axis of the two smaller 
coordinates as a first minor axis and a second minor axis. 
Multiplexor 1515 then supplies these minor axes' coordi- 
nates to multipliers 1525. These multipliers in turn generate 
the indexed location on the indexed face of the cubic 
environment map by multiplying the two minor coordinates 
by the output of divider 1520. 

It will be appreciated that the apparatus of the invention 
may be a general purpose processor (e.g. a microprocessor 
or a microcontroller or an ASIC) which is controlled by 
software to generate the unnormalized reflection vector at a 
pixel location and then to decode this vector to produce a 
location indexed by this vector in a selected 2-dimensional 

iment may be 



map in the environment map. This ei 
implemented by having the software instruct the processor 
to compute the reflection vector in the manner described 
above (e.g. equation iii) and to decode the vector also in the 
manner described above. 

As mentioned before, computer graphic systems have 
long sought to incorporate surface reflections in their com- 
puter graphic models, because surface reflections are useful 
for appraising the smoothness and the curvature of complex 
surfaces. By utilizing the above-described teachings of the 



1325 then generate the 2*N*(N-E) component of equation 

(Hi), while the fourth set of rnultipliers 1320 generates the 35 presentmvention, computer" graphic systems can noVgen- 
E*(N-N) component of equation (iii). Finally, subtracter era tc surf ace reflection sat real time speeds allowing the user 
1340 subtracts the output of the fourth set of multiplier 1320 to interactively manipulate the computer images presented 
from the output of times two multiplier 1325 in order to by such systems. More specifically, a computer graphic 
produce the above-mentioned equation (iii). system can now allow its viewers to inspect the surface 

Thus, in one embodiment of the present invention, reflec- 40 curvature and smoothness of its model (1) by generating 
tion vector generator 1205 of FIG. 10 uses the above- reflection vectors, which can be unnormalized, for every 
mentioned equation (iii) to generate a reflection vector based displayed point of its model, and (2) by shading its model 
on the Dormal and the eye vectors which need not be with the images that these reflection vectors index on an 
normalized Reflection vector generator 1205 then supplies environment map. 
the generated reflection vector to decoder 1210. In turn, 45 
decoder 1210 determines the location where the reflection 
vector indexes a three-dimensional environment map in the 
manner described above (e.g. steps 615 and 620 of FIG, 5), 
Decoder 1210 of FIG. 10 then supplies this indexed location 



Alternatively, if a computer generated object is relatively 
far from the viewer (Le., if the eye vector changes relatively 
slowly across the surface of the computer generated object), 
a computer graphic system can render this object with rich 
surface reflections by (1). generating reflection vectors, that 



to a conventional texture mapping device, which in turn 50 can be unnormalized, for the vertices of the polygons 
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projects the two-dimensional image indexed on the envi- 
ronment map onto particular pixel P. 

For the embodiments of reflection vector shading hard- 
ware 1200 that are designed to operate with a cubic envi- 
ronment map which is aligned with the axis of the coordinate 55 
system which specifies the reflection vector, FIG. 12 sets 
forth an embodiment of decoder 1210, As shown in this 
figure, decoder 1500 includes select logic 1510, multiplexor 
1515, divider 1520, and two multipliers 1525. This decoder 

receives the x, y, and z components of the generated reflec- 60 which does not require the normalization of the reflection 
tion vector from reflection vector generator 1205, in order vectors. In fact, if computer graphic systems employ the 
(1) to determine the indexed face of a cubic environment embodiments of the present invention that utilize the above- 
map that the reflection vector selects/indexes, and (2) to mentioned equation (iii) to generate reflection vectors, these 
determine the indexed location on this indexed face. systems can render rich surface reflections at real time 

The select logic 1510 is coupled to receive the cornpo- 65 speeds by only computing two dot products, two vector 
nents Rx. Ry, Rz of the reflection vector and determines the scaling products, and a vector subtraction for each reflection 
ronrponent of the reflection vector that has the largest vector. 



representing this object, (2) generating the remaining reflec- 
tion vectors for this object through linear interpolation, and 
(3) shading this object with the images that these generated 
reflection vectors index on an environment map. 

The present invention enables computer graphic systems 
to produce rich surface reflections at real time speeds (I.e., 
at speeds that allow the viewer to move interactively with 
respect to the computer generated object), because the 
present invention provides an environment mapping method 



5,704,024 



17 



10 



15 



The present invention is further advantageous because it 
provides a method and an apparatus for rendering high- 
quality specular highlights in real time and independent of 
the number of light sources. As mentioned above, because 
the present invention provides a shading method which does 
not require the normalization of the reflection vectors, the 
present invention enables computer graphic systems to pro- 
duce rich surface reflections (such as specular highlights) at 
real time speeds allowing interactive use by a user of the 
computer system 

In addition, since environment maps are pre -computed 
and since these maps can contain any number of area light 
sources, the present invention does not suffer from any 
rendering-time penalty for rendering specular highlights 
when there is a high number of light sources. Thus, by 
incorporating an arbitrary number of light sources into an 
environment map that is indexed by reflection vectors that 
are generated at real time speeds, the present invention can 
render high quality specular highlights in real time and 
independent of the number of light sources. Specular spread 
functions can be incorporated into the environment map 20 
itself if they are based solely on relative reflection angle. 
Thus, a Phong highlight can be incorporated, allowing 
real-time interactive Phong shading. 

Furthermore, die embodiments of the present invention 
that generate index values for a cubic environment map arc 25 
also advantageous because these embodiments do not need 
to utilize perspective-correcting texture hardware. When a 
computer graphic system incorporates perspective viewing 
in its model the reflection direction has to be projected from 
screen space back to the world space of the environment 
map, in order to insure that the reflection vector correctly 30 
indexes the environment map. Perspective viewing is 
accomplished by using homogenous factor 1/w (where w is 
proportional to the distance between a viewer and a dis- 
played point) to substitute NAv and E/w for the normal and 
the eye vectors iterated in screen space. These two substi- 35 
tuted vectors are then used to calculate R/w. 

Prior art environment mapping techniques then employ 
perspective-correct texture divider to divide the result of this 
calculation (i.e., R/w) by 1/w at each pixel in order to return 
the reflection vector to the world space coordinates direc- 40 
tion. However, the embodiments of the present invention 
that generate index values obviate the need for this divider, 
because in these embodiments the w's in the denominators 
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3. The method of claim 2 wherein said method is used to 
render specular highlights. 

4. The method of claim 1, wherein R=2*N*(N-E>-E* 
(N'N). 

5. A method for generating a reflection vector that indexes 
one of a plurality of faces of a cubic environment map stored 
io a memory, said method comprising the steps of: 

receiving an eye vector (E) and a normal vector (N); 
producing a reflection vector (R) represented by a first 
coordinate, a second coordinate, and a third coordinate, 
wherein the reflection vector is unnormalized when one 
oif the normal vector and the eye vector is unnormal- 
ized; 

determining a largest coordinate having the largest mag- 
nitude of said first, second, and third coordinates; and 
generating a fourth coordinate, and a fifth coordinate, by 
dividing two of said first, second, and third coordinates 
by said largest coordinate, wherein said fourth, and fifth 
coordinates define the location on the cubic environ- 
ment map where said reflection vector indexes said 
cubic environment map in said memory. 

6. The method for generating a reflection vector of claim 
S t wherein R=2*N*(N-E>-E*(N-N). 

7. In a data processing system which renders images, a 
method of generating reflections off a rendered object by 
using an environment representation comprising a set of 
2-dimensionaI maps which are independent of a viewer's 
position, said method comprising: 

receiving an eye vector (E) and a normal vector (N), at 
least one of which is not normalized; 

producing a reflection vector (R) without vector normal- 
ization; 

selecting a selected 2-dimensional map which contains a 
location indexed by said reflection vector; 

determining said location on said selected 2-dimensional 
map; and 

sampling a reflection shading value at said location in said 
selected 2-dimensional map. 

8. The method of claim 7, wherein R=2*N*(N-E)-E* 
(N-N). 

9. A method as in claim 7 wherein said environment 
representation comprises six 2-dimensional maps arranged 
as the faces of a cube which is aligned to an axis of a 



of each component of R/w cancel. These embodiments of 

the present invention then can use the prior art perspective- 45 coordinate system, and wherein saidTtep of Selecting com- 
correct divider for index calculations. prises selecting the 2-dimensional map corresponding to the 

One of ordinary skill in the art would recognize that the largest component of said reflection vector and wherein said 
above-described invention may be embodied in other spe- step of determining comprises dividing the two smaller 
cific forms without departing from the spirit or the essential components of said reflection vector by said largest corn- 
characteristics of the disclosure. For instance, in alternative 50 ponent 

embodiments of the present invention, other polygonal- 10. A method as in claim 7 wherein said environment 
faced surfaces, such as dodecahedron or isocahedron can be representation comprises eight 2-dimensional maps 
used as environment maps. Thus, while certain exemplary arranged as the triangular faces of an octahedron which is 
embodiments have been described and shown in the accom- aligned to an axis of a coordinate system, and wherein said 
panying drawings, the invention is not to be limited by the 55 step of selecting comprises selecting the 2-dimensional map 



foregoing illustrative details but rather is to be defined by the 
appended claims. 
What is claimed is: 

1. A method for generating a reflection vector, said 
method comprising the steps of: 

a) receiving an eye vector (E) and a normal vector (N) at 
least one of which is not normalized; and . 

b) producing a reflection vector (R) without vector nor- 
malization. 

2. The method of claim 1 further comprising the step of 65 
deteirnining the location where the reflection vector indexes 
an environment map. 



corresponding to the direction indicated by the signs of a 
plurality of components of said reflection vectors and 
wherein said step of determining comprises dividing a 
plurality of magnitudes of said plurality of components by a 
60 sum of the magnitudes of said plurality of components. 
11. A reflection vector generating apparatus for generating 
a reflection vector indexing one of a plurality of faces of an 
environment map, said apparatus comprising: 
a) a reflection vector generator which receives an eye 
vector and a normal vector at least one of which is not 
normalized, said reflection vector generator producing 
a reflection vector without vector normalization; 
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b) a decoder coupled to the reflection vector generator to 
receive the reflection vector, said decoder determining 
the face of said environment map that said reflection 
vector indexes. 

12. An apparatus as in claim 11 wherein said reflection 
vector generator comprises a plurality of multipliers and a 
shifter. 

13. An apparatus as in claim 11 wherein said decoder 
comprises a multiplexer and a divider. 



a display, said display displaying a rendered object having 
reflections which are produced by said reflection gen- 
erator; 

a processor coupled to said display, said processor calcu- 
lating said eye vector and said normal vector and 
providing said eye and normal vectors to said reflection 
vector generator. 
17. A method as in claim 7, wherein said rendered object 
includes a first pixel, and wherein said method further 



14. An apparatus as in claim 11 wherein said reflection io comprises calculating a pixel shading value for said first 



vector generator and said decoder comprise one of a micro- 
processor or a microcontroller which is controlled by soft- 
ware to generate said reflection vector and to determine the 
face of said environment map which said reflection vector 
indexes. 

15. An apparatus as in claim U wherein said decoder 
further determines an indexed location on said face. 

16. An apparatus as in claim 11 further comprising: 

memory coupled to said decoder, said memory storing 
said environment map; 



pixel using said reflection shading value and displaying on 
said display device said first pixel having said pixel shading 
value. 

18. A method as in claim 7 wherein said method is used 
15 to render specular highlights. 

19. A method as in claim 18 wherein said environment 
representation includes a representation of specular high- 
lights. 
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ABSTRACT 



A system and method for environment mapping determines 
a computer-generated object's reflective appearance, based 
upon position and orientation of a camera with respect to the 
object's location. The present invention is implemented as a 
real-time environment mapping for polygon rendering, how- 
ever, the scope of the invention covers other rendering 
schemes. According to one embodiment of the present 
invention, a vector processing unit (VPU) uses a modified 
reflection formula to compute reflective properties of an 
object. The modified reflection formula is: 

r=e-(e<n+e 0 ))(n+ej/(l-nz)=e-(e-[nx, ny, nz-l])[nx, 
ny, nz-l]/(l-nz), where e o ^[0,0,-l], and nx, ny, and 
nz are the components of the surface normal vector, 
n. 
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SYSTEM AND METHOD FOR ENVIRONMENT 

MAPPING 

CROSS REFERENCE TO RELATED 
APPLICATION 

[0001] This application claims the benefit of U.S. Provi- 
sional Patent Application Serial No. 60/328,490, entitled 
"Environment Mapping," filed on Oct. 10, 2001, which is 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
[0002] 1. Field of the Invention 

[0003] This invention relates generally to computer gen- 
erated images and more particularly to a system and method 
for environment mapping. 

[0004] 2. Description of the Background Art 

[0005] Typically, the illumination of a computer-generated 
object by discrete light sources, continuous light sources, 
and ambient light is described by an illumination model. The 
object is illuminated by the reflection of ambient light and 
the reflection of light source light from the surface of the 
object. Generally, the illumination model is a mathematical 
expression that operates on a set of variables to generate 
reflection properties, such as color and intensity of reflected 
light and an object's texture as viewed by an observer. Given 
ambient light and light sources positioned about the object, 
the illumination model defines the reflection properties of 
the object. The illumination model is considered to be 
accurate if the illuminated object appears realistic to an 
observer. 

[0006] Typically, the illumination model is incorporated in 
a software program executed by a vector processing unit, a 
central processing unit, or a rendering engine of a computer 
system. The program must be capable of computing the 
illumination of the object when the light sources change 
position with respect to the object, when the observer views 
the illuminated object from a different angle, or when the 
object is rotated. Furthermore, an efficient illumination 
model is needed for the processing unit to compute the 
illumination in real-time, for example, if the observer (i.e., 
a camera) is moving with respect to the object. Therefore, it 
is desired to incorporate terms in the illumination model that 
are computationally cost effective, while at the same time 
generating an image of the illuminated object that is aes- 
thetically pleasing to the observer. 

[0007] Computing texture (i.e., environment mapping) is 
important when rendering a realistic image of the illumi- 
nated object that closely resembles a real physical object. 
Typically, texture coordinates for each point of the object's 
surface are computed, and a texture map comprising the 
texture coordinates is generated. 

[0008] FIG. 1 illustrates a prior art direct normal projec- 
tion method for computing an object's texture coordinates. 
FIG. 1 includes an object's surface 105, a point P on surface 
105, a normal vector n to surface 105 at point P, an observer 
110a, a line-of sight 115a between observer 110a and the 
point P, and a projection of the normal vector n onto an 
x-axis 120, referred to as n x . In general, a z-axis (not shown) 
is perpendicular to x-axis 120 and is in the plane of FIG. 1, 
and a y-axis (not shown) is perpendicular to x-axis 120 and 



the z-axis and is out of the plane of FIG. 1. For simplicity 
of illustration, the FIG. 1 embodiment of object's surface 
105 is a line, however, surface 105 is typically any 2-D 
surface, and hence in general, the normal vector n may have 
a vector component n y along the y-axis. 

[0009] In operation, the direct normal projection method 
computes the projected components n x and n y of the normal 
vector n for each point P on object's surface 105. The central 
processing unit or vector processing unit then maps (i.e., 
transforms) the projected components n^ and n y into texture 
coordinates (s,t) using one or more mapping algorithms 
known in the art. The vector processing unit then uses the 
computed texture coordinates (s,t) for each point P, as well 
as other reflection variables, in an illumination model to 
generate a reflection pattern of object's surface 105. 
Although the direct normal projection method of the prior 
art may be fast, the method generates a reflection pattern that 
appears "painted-on" as observer 110a moves to different 
locations. In other words, the reflection pattern of object's 
surface 105 does not change with respect to rotation or 
translation of observer 110a, since the method depends upon 
the x and y components of the normal vector n, independent 
of the position of observer 110a with respect to the point P. 
For example, the vector processing unit computes the same 
projected components (n^,n y ) and texture coordinates (s,t) 
for an observer 1106 viewing point P as observer 110a 
viewing point P. 

[0010] It would be useful to implement a system and 
method of environment mapping that depends upon an 
observer's location with respect to an object's location and 
orientation to generate a more realistic reflection pattern, and 
that is consistent with results of the direct normal projection 
method for particular object-observer geometries. 

SUMMARY OF THE INVENTION 

[0011] In accordance with the present invention, a system 
and method for environment mapping of a reflective object 
is disclosed. In one embodiment of the invention, the 
method includes constructing a surface normal vector n at a 
point P on a surface of the reflective object, constructing an 
observation vector e from the point P to an observer, and 
using a modified reflection formula to compute a reflection 
vector r based on the surface normal vector n and the 
observation vector e. The modified reflection formula is 
based on reflection about a pseudo-normal vector n' at the 
point P on the surface. 

[0012] According to the present invention, the pseudo- 
normal vector n' bisects an angle subtended by the surface 
normal vector n and a reference observation vector e Q , where 
the reference observation vector e Q is directed from the point 
P to an observer located directly in front of the point P. 

[0013] The modified reflection formula is: 

[0014] r=e-(e-(n+e 0 ))(n+e 0 )/(l-nz)=e-(e-[nx, ny, 
nz-l])[nx, ny, nz-l]/(l-nz), where e o 40,0,-l], and 
nx, ny, and nz are the components of the surface 
normal vector n. Each computed reflection vector r 
may be processed to generate a pair of texture 
coordinates (s,t). The reflective object is then ren- 
dered based in part on the texture coordinates (s,t) 
associated with each point P on the surface of the 
reflective object. The scope of the present invention 
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covers all types of rendering schemes, such as a 
polygon rendering where each point P on the surface 
of the reflective object is located at the vertex of a 
polygon. 

[0015] In another embodiment of the invention, the system 
includes a memory configured to store a modified reflection 
model, a vector processing unit configured to compute 
reflection vectors using the modified reflection model, and a 
graphics processor configured to render the reflective object 
in an image. The quality of the image is dependent upon the 
texture coordinates that are derived from the computed 
reflection vectors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] FIG. 1 illustrates a prior art direct normal projec- 
tion method for computing an object's texture coordinates; 

[0017] FIG. 2 is a block diagram of one embodiment of an 
electronic entertainment system according to the invention; 

[0018] FIG. 3 illustrates a modified reflection projection 
method stored in main memory 210 of FIG. 2, according to 
one embodiment of the invention; 

[0019] FIG. 4 is a flowchart of method steps for display- 
ing an image of a reflective object based upon texture 
coordinates, according to one embodiment of the invention; 
and 

[0020] FIG. 5 is a flowchart of method steps for step 415 
of FIG. 4 to generate reflection vectors for a reflective 
object, according to one embodiment of the invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

[0021] The system and method for environment mapping 
described herein allow a computer-generated object's reflec- 
tive appearance to change, based upon position and orien- 
tation of a camera with respect to the object's location. A 
position of the camera may be defined by a lateral location 
of the camera with respect to the object's location. Lateral 
camera movement is defined as motion to the right, left, up, 
or down with respect to the object's location. Camera 
orientation may be defined by rotation angles with respect to 
a given, fixed coordinate system. 

[0022] An exemplary embodiment of the invention is 
implemented as a real-time environment mapping for poly- 
gon rendering. However, the scope of the invention covers 
other applications, such as environment mapping for other 
rendering schemes. Other rendering schemes may include, 
but are not limited to, point-based and non-polygon volume- 
based primitives. Various embodiments of the invention may 
be enabled in software, hardware, or firmware. 

[0023] According to one embodiment of the invention, a 
central processing unit (CPU) and/or one or more vector 
processing units (VPUs) use illumination models to com- 
pute reflective properties of an object. The object's reflective 
properties are associated with the objects' appearance. 
Reflective properties include color and intensity of light 
reflected by the object, and texture of the reflective object. 
The texture of an object is associated with reflective prop- 
erties such as the object's shininess and overall surface 
appearance. Typically, the object's texture is specified by 
texture coordinates (s,t) computed by the VPU. Texture 



coordinates may be incorporated into a texture map which is 
wrapped (i.e., mapped) around the object. For example, a 
VPU may execute environment mapping instructions that 
operate on variables stored in a VPU random access memory 
(RAM) or on variables stored in a CPU register to compute 
the texture coordinates. Typically the texture coordinates 
and the other computed reflective properties (also referred to 
as illumination terms) such as color and intensity are passed 
to a graphics processing unit (GPU) for further processing. 
Subsequently, the GPU prepares the reflective object for 
display on a display device such as a computer monitor. 

[0024] FIG. 2 is a block diagram of one embodiment of an 
electronic entertainment system 200 according to the inven- 
tion. System 200 includes, but is not limited to, a main 
memory 210, a CPU 212, a VPU 213, a GPU 214, an 
input/output processor (IOP) 216, an I OP memory 218, a 
controller interface 220, a memory card 222, a Universal 
Serial Bus (USB) interface 224, and an IEEE 1394 interface 
226. System 200 also includes an operating system read- 
only memory (OS ROM) 228, a sound processing unit 
(SPU) 232, an optical disc control unit 234, and a hard disc 
drive (HDD) 236, which are connected via a bus 246 to IOP 
216. 

[0025] CPU 212, VPU 213, GPU 214, and IOP 216 
communicate via a system bus 244. CPU 212 communicates 
with main memory 210 via a dedicated bus 242. VPU 213 
and GPU 214 may also communicate via a dedicated bus 
240. 

[0026] CPU 212 executes programs stored in OS ROM 
228 and main memory 210. Main memory 210 may contain 
pre-stored programs and may also contain programs trans- 
ferred via IOP 216 from a CD-ROM or DVD-ROM (not 
shown) using optical disc control unit 234. IOP 216 controls 
data exchanges between CPU 212, VPU 213, GPU 214 and 
other devices of system 200, such as controller interface 
220. 

[0027] Main memory 210 includes, but is not limited to, a 
program having game instructions including an illumination 
model. The program is preferably loaded from a DVD-ROM 
via optical disc control unit 234 into main memory 210. 
CPU 212, in conjunction with VPU 213, GPU 214, and SPU 
232, executes game instructions and generates rendering 
instructions using inputs received from a user via controller 
interface 220. The user may also instruct CPU 212 to store 
certain game information on memory card 222. Other 
devices may be connected to system 200 via USB interface 
224 and IEEE 1394 interface 226. 

[0028] In one embodiment of the invention, VPU 213 
executes instructions from CPU 212 to generate texture 
coordinates associated with an illuminated object by using 
the illumination model. SPU 232 executes instructions from 
CPU 212 to produce sound signals that are output on an 
audio device (not shown), GPU 214 executes rendering 
instructions from CPU 212 and VPU 213 to produce images 
for display on a display device (not shown). That is, GPU 
214, using the texture coordinates and other illumination 
terms generated by VPU 213, and rendering instructions 
from CPU 212, renders the illuminated object in an image. 

[0029] FIG. 3 illustrates a modified environment reflec- 
tion projection method stored in main memory 210 of FIG. 
2, according to the present invention. In one embodiment of 
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the invention, the modified reflection projection method is 
used by the illumination model. In another embodiment of 
the invention, the modified reflection projection method is 
incorporated into the illumination model. FIG. 3 includes an 
object's surface 305, a point P on the surface 305, a normal 
vector n to the surface 305 at point P (also referred to as a 
surface normal vector), an observer 310a, an observation 
vector e directed from the point P to observer 310a, and an 
x-axis 320. In one embodiment of the invention, surface 305 
is composed of polygon primitives (not shown), and at each- 
vertex of each polygon, a point P is specified on surface 305. 
For future reference, the z-axis (not shown) is perpendicular 
to x-axis' 320 and is in the plane of FIG. 3, and the y-axis 
(not shown) is perpendicular to x-axis 320 and the z-axis and 
is out of the plane of FIG. 3. For simplicity of illustration, 
the FIG. 3 embodiment of surface 305 is a line, however, 
any point P on any two-dimensional surface is within the 
scope of the invention. For example, the FIG. 3 embodiment 
of surface 305 may be the intersection of a two-dimensional 
surface (not shown) with the x-z plane, and thus the normal 
vector n may have a vector component n y along the y-axis. 

[0030] According to one embodiment of the invention, the 
modified environment reflection projection method uses a 
modified version of a standard reflection formula to calcu- 
late a reflection vector r for each point P on surface 305. The 
method then processes the reflection vector r to generate 
texture coordinates (s,t) for each point P. The standard 
reflection formula is r=e-2(e-n)n. For each point P specified 
on surface 305 with a given normal n, the standard reflection 
formula gives a reflection vector r based upon a given 
observer position specified by the observation vector e. The 
standard reflection formula is a vector relationship that 
satisfies Snell's law of reflection, where the angle of inci- 
dence a 2 (FIG. 3) is equal to the angle of reflection a r (FIG. 
3). 

[0031] According to one embodiment of the invention, 
VPU 213 (FIG. 2) uses a modified version of the standard 
reflection formula to compute reflection vectors. For the 
point P on surface 305 located directly in front of observer 
310a (i.e., observation vector e intersects x-axis 320 at a 
right angle), the standard reflection formula is modified such 
that a reflection vector r' given by the modified reflection 
formula is equal to the normal vector n. That is, r'«n. Thus, 
the modified reflection projection method produces the same 
result as the direct normal projection method when the point 
P on surface 305 is located directly in front of observer 310a. 

[0032] In order to modify the standard reflection formula, 
a pseudo-normal vector n' is defined that bisects the angle of 
incidence a : subtended by the observation vector e and the 
normal vector n. That is, n'=(e+n)/(|e+n |) where |e+n | is the 
magnitude of e+n, and angle b £ is equal to angle b r . When the 
pseudo-normal vector n' is substituted for the normal vector 
n in the standard reflection formula, the resultant modified 
reflection vector r' is equal to the normal vector n, since the 
modified reflection formula is based on the principle of 
Snell's law, where angle b 2 =angle b r . Thus, the modified 
reflection formula is expressed as r'=n=e-2(e , n , )n'. 

[0033] A simplification of the modified reflection formula 
is straightforward. Assuming that point P is located at 
(x,y,z)=(0,0,z), then the unit normal vector n has compo- 
nents [nx, ny, nz] and the unit observation vector e has 
components [0,0,-1], where brackets [] are used to specify 



vector quantities. For example, [nx, ny, nz] is another way 
of writing vector n. Now, substituting the components of n 
and e into the expression for n', one obtains n'=(e+n)/(|e+ 
n|)=[nx, ny, nz~l]/(sqrt(nx 2 +ny 2 +(nz-l) 2 )). Expanding the 
argument of the square root in the denominator, one obtains 
nx 2 +ny 2 +(nz-l) 2 «nx 2 +ny 2 +nz 2 +l-2nz=l+l-2nz=2(l-nz), 
since the normal vector n is a unit vector of magnitude one. 
If k=l/sqrt(2(l-nz)), then n'=k[nx, ny, nz-1]. 

[0034] Now, substituting n' into the modified reflection 
formula, one obtains r , =n=e-2(e-n r )n'=e-2k 2 (e-[nx, ny, 
nz-l])[nx, ny, nz-l]-e-(e-[nx, ny, nz-l])[nx, ny, nz-l]/(l~ 
nz). That is, r'=e-(e-[nx, ny, nz-l])[nx, ny, nz-l]/(l-nz) for 
any given observation vector e. In other words, the modified 
reflection formula is valid for any given observation vector 
e=[ex, ey, ez], and any point P on surface 305 with an 
associated unit normal vector n=[nx, ny, nz]. For example, 
if observer 3106 views point P along an observation vector 
e", then VPU 213 uses the modified reflection formula to 
compute a reflection vector r", where 

[0035] r"=e"-(e"-[nx, ny, nz-l])[nx, ny, nz-l]/(l- 
nz). 

[0036] The modified reflection formula may be simplified 
further, and expressed by a more compact mathematical 
relationship. For example, if the unit observation vector 
e=[0,0,-l] is relabeled as a constant reference observation 
vector e G , then the modified reflection formula may be 
written as r'=e-(e-[nx, ny, nz-l])[nx, ny, nz-l]/(l-nz)=e- 
(e-(n+e 0 ))(n+e 0 )/(l-nz). 

[0037] FIG. 4 is a flowchart of method steps for display- 
ing an image of a reflective object based upon texture 
coordinates, according to one embodiment of the invention. 
In step 405, a user loads video software into memory 210 
(FIG. 2) via optical disc control unit 234 (FIG. 2), for 
example, and CPU 212 (FIG. 2) executes the video soft- 
ware. The video software may be an interactive or non- 
interactive video, and in an exemplary embodiment of the 
invention, the video software is a video game. In step 410, 
CPU 212 generates rendering instructions for all reflective 
objects of a video frame. The rendering instructions may be 
generated in response to user input received via controller 
interface 220 (FIG. 2). In step 415, VPU 213 (FIG. 2) 
executes the rendering instructions using an illumination 
model, and generates reflection vectors for each reflective 
object of the video frame. For example, a reflection vector 
is generated for each vertex point P (FIG. 3) of surface 305 
(FIG. 3). Step 415 is further discussed below in conjunction 
with FIG. 5. 

[0038] In step 420, VPU 213 transforms the reflection 
vectors associated with each object to texture coordinates. 
The transformation may be a reflection vector mapping 
method, or may be configured using other known methods 
in the art. In addition, VPU 213 may compute a texture map 
composed of the texture coordinates for each reflective 
object. Next, in step 425, VPU 213 sends the texture 
coordinates and/or texture maps to GPU 214. In step 430, 
GPU 214 prepares an image of each reflective object for 
display on a display device (not shown), based in part on the 
texture coordinates or texture map associated with each 
reflective object. GPU 214 may use other illumination terms 
generated by VPU 213 or CPU 212 in conjunction with the 
texture coordinates to prepare each reflective object for 
display as an image. 
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[0039] Next, in step 435, CPU 212 determines if execution 
of the video game has been terminated. If execution has not 
terminated, then the method continues with the next video 
frame at step 410. However, if in step 435, CPU 212 
ascertains that execution of the video game has terminated, 
then the method ends. 

[0040] FIG. 5 is a flowchart of method steps for generat- 
ing reflection vectors for a reflective object, according to one 
embodiment of the invention. In step 505, VPU 213 (FIG. 

2) selects a vertex point P (FIG. 3) on surface 305 (FIG. 3) 
of the reflective object. Next, in step 510, VPU 213 obtains 
vector components [nx,ny,nz] of a normal vector n (FIG. 3) 
to the surface 305 of the reflective object at the selected 
vertex point P. In one embodiment of the invention, the 
vector components are stored in registers (not shown) asso- 
ciated with CPU 212. In another embodiment of the inven- 
tion, the vector components are stored in a memory (not 
shown) associated with VPU 213. 

[0041] In step 515, VPU 213 determines components 
[ex ,, ,ey",ez"] of the observation vector e" (FIG. 3), for 
example, directed from the point P to observer 3106 (FIG. 

3) . VPU 213 may compute the components [ex",ey",ez"] or 
may receive the components from VPU 213 memory (not 
shown) or CPU 212 registers (not shown). Next, VPU 213 
uses a modified reflection formula, the components (ex", 
ey",ez") of the observation vector e", and the vector com- 
ponents (nx,ny,nz) of the normal vector n to compute a 
reflection vector r" (FIG. 3), in step 520. In step 525, VPU 
213 determines whether a reflection vector for each vertex 
point P associated with the reflective object has been com- 
puted. If a reflection vector for each vertex point P has not 
been computed, then in step 530, VPU 213 selects another 
vertex point P on surface 305 of the reflective object. The 
method then continues at step 510. However, if in step 525, 
a reflection vector for each vertex point P has been com- 
puted, then the method ends. 

[0042] The invention has been explained above with ref- 
erence to several embodiments. Other embodiments will be 
apparent to those skilled in the art in light of this disclosure. 
The present invention may readily be implemented using 
configurations other than those described in the embodi- 
ments above. For example, the modified environment reflec- 
tion projection method, according to the invention, may be 
executed in part or in whole by CPU 212, VPU 213, GPU 
214, or a rendering engine (not shown). Or, for example, the 
modified environment reflection projection method may be 
implemented in parallel by a multiprocessor system. Addi- 
tionally, the present invention may effectively be used in 
conjunction with systems other than those described in the 
embodiments above. Therefore, these and other variations 
upon the disclosed embodiments are intended to be covered 
by the present invention, which is limited only by the 
appended claims. 

What is claimed is: 

1. A method for environment mapping, comprising the 
steps of: 

determining a surface normal vector n at a point P on a 
surface of a reflective object; 

determining an observation vector e from the point P to an 
observer; and 
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using a modified reflection formula to compute a reflec- 
tion vector r based on the surface normal vector n and 
the observation vector e, the modified reflection for- 
mula based on reflection about a pseudo-normal vector 
n' at the point P on the surface. 

2. The method of claim 1, wherein the pseudo-normal 
vector n' bisects an angle subtended by the surface normal 
vector n and a reference observation vector e Q , the reference 
observation vector e 0 directed from the point P to the 
observer located directly in front of the point P. 

3. The method of claim 1, wherein the modified reflection 
formula is r=e-(e-[nx, ny, nz-l])[nx, ny, nz~l]/(l-nz), 
where nx, ny, and nz are the components of the surface 
normal vector n. 

4. The method of claim 1, wherein the point P on the 
surface of the reflective object is located at a vertex of a 
polygon. 

5. The method of claim 1, further comprising the step of 
transforming the reflection vector r to texture coordinates 
(s,t). 

6. The method of claim 5, further comprising the step of 
rendering the reflective object based on the texture coordi- 
nates (s,t) associated with each point P on the surface of the 
reflective object. 

7. An electronic-readable medium having embodied 
thereon a program, the program being executable by a 
machine to perform method steps for environment mapping, 
the method steps comprising: 

determining a surface normal vector n at a point P on a 
surface of a reflective object; 

determining an observation vector e from the point P to an 
observer; and 

using a modified reflection formula to compute a reflec- 
tion vector r based on the surface normal vector n and 
the observation vector e, the modified reflection for- 
mula based on reflection about a pseudo-normal vector 
n 1 at the point P on the surface. 

8. The electronic-readable medium of claim 7, wherein 
the pseudo-normal vector n' bisects an angle subtended by 
the surface normal vector n and a reference observation 
vector e Q , the reference observation vector e Q directed from 
the point P to the observer located directly in front of the 
point P. 

9. The electronic-readable medium of claim 7, wherein 
the modified reflection formula is r*=e-(e-[nx, ny, nz-l])[nx, 
ny, nz-l]/(l-nz), where nx, ny, and nz are the components 
of the surface normal vector n. 

10. The electronic-readable medium of claim 7, wherein 
the point P on the surface of the reflective object is located 
at a vertex of a polygon. 

11. The electronic-readable medium of claim 7, further 
comprising the step of transforming the reflection vector r to 
texture coordinates (s,t). 

12. The electronic-readable medium of claim 11, further 
comprising the step of rendering the reflective object based 
on the texture coordinates (s,t) associated with each point P 
on the surface of the reflective object. 

13. A system for environment mapping of a reflective 
object, comprising: 

a memory configured to store a modified reflection model, 
the modified reflection model based on reflection about 
pseudo-normal vectors located at points on a surface of 
the reflective object; 
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a vector processing unit configured to compute reflection 
vectors using the'modified reflection model; and 

a graphics processing unit configured to render the reflec- 
tive object in an image, the quality of the image 
dependent upon the computed reflection vectors. 

14. The system of claim 13, wherein the modified reflec- 
tion formula is r=e-(e-[nx, ny, nz-l])[nx, ny, nz-l]/(l-nz), 
where nx, ny, and nz are components of a surface normal 
vector n at a point P on the reflective surface, and e is an 
observation vector directed from the point P to an observer. 

15. The system of claim 13, wherein a pseudo-normal 
vector n' bisects an angle subtended by a surface normal 
vector n at a point P on the reflective surface and a reference 
observation vector e G , the reference observation vector e 0 
directed from the point P to an observer located directly in 
front of the point P. 



16. The system of claim 13, wherein the vector processing 
unit is further configured to process each computed reflec- 
tion vector to generate texture coordinates (s,t). 

17. The system of claim 16, wherein the graphics pro- 
cessing unit uses the texture coordinates to render the 
reflective object as an image. 

18. A system for environment mapping, comprising: 

means for determining a surface normal vector n at a point 
P on a surface of a reflective object; 

means for determining an observation vector e from the 
point P to an observer; and 

means for using a modified reflection formula to compute 
a reflection vector r based on the surface normal vector 
n and the observation vector e, the modified reflection 
formula based on reflection about a pseudo -normal 
vector n' at the point P on the surface. 



